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Printing  History 

The  development  of  KPIs  and  the  implementation  of  data  reporting  processes  involved  working  with 
committees  representing  each  of  the  major  sectors  of  the  post-secondary  system  (public  colleges, 
technical  institutes,  and  AVCs;  universities;  and  private  colleges).  In  each  case,  a  "reporting  manual" 
summarized  all  of  the  agreements  made  between  the  institutions  and  the  department.  Because  each 
committee's  work  proceeded  at  a  different  pace,  the  early  versions  of  this  manual  appeared  as  separate 
manuals  for  each  sector.  During  1996-97  it  has  become  possible  for  the  three  manuals  to  be  consolidated 
into  one.  A  single  manual  better  reflects  and  facilitates  an  important  part  of  the  original  objective,  which 
was  to  develop  a  set  of  indicators  that  would  apply  system-wide. 


Reporting  Manuals  for  each  sector 

Colleges  &  Technical  Institutes 

September  1995  (Pilot  Draft) 

May  1996  (Pilot  Draft  -  Round  Two) 

November  1996 
Universities 

Fall  1995  (Pilot  Draft,  Round  One  was  available  in  electronic  form  only) 
June  1996  (Pilot  Draft  -  Round  Two) 

December  1996 
Private  Colleges 

Spring  1997  (available  in  electronic  form  only) 

Common  Reporting  Manual 

November  1997 

This  edition  consolidates  and  replaces  the  separate  manuals  prepared  for  each  institutional  sector  for  the  pilot  and  start-up  year  of  data  collection. 

December  1997 

This  version  includes  correction  of  errors  and  omissions  as  at  December  15,  1997. 


Reporting  Software 

Reporting  software  has  been  produced  to  accompany  this  manual.  Version  5.0  is  the  first  version  that 
will  be  provided  to  the  universities.  That  version  can  allow  universities  to  report  only  partial  data;  they 
will  receive  a  version  that  allows  complete  reporting  just  as  soon  as  the  universities  are  part  of  the 
system-wide  enrolment  and  program  reporting  system. 

Version  1.0 -May  24,  1996 
Version  1.01  -  June  25,  1996 
Version  1.2  -  September  9,  1996 
Version  1.3  (B)  -  November  1996 
Version  2.0  -  November  1996. 
Version  5.0  -  November  1997  to  accompany  this  manual. 
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Major  Changes  from  Earlier  Editions 

This  manual  incorporates  a  number  of  changes,  the  most  obvious  of  which  is  the  consolidation  of  the 
separate  manuals  for  each  sector  into  one  volume.  But  this,  and  the  various  other  changes  in  methods  of 
presentation  and  organization  of  reference  information,  have  not  introduced  substantive  changes  in  the 
indicators  themselves  or  the  methodologies  set  out  for  their  generation  of  data  and  determination  of  each. 
No  new  indicators  have  been  added  to  the  reporting  requirements  for  the  next  round  (January  1998). 
And  very  few  substantive  changes  have  been  introduced  for  any  reasons. 

Major  Changes: 

•  the  three  sector  manuals  consolidated  into  one  system  manual 

•  new  information  in  the  Introduction  about  the  AECD  System  Information  branch,  adjusted 
reporting  schedules,  a  system-wide  KPI  listserver,  and  information  about  the  continuing 
development  of  CIS,  FIRS  and  KPIRS 

•  the  reporting  deadline  for  1996-97  data  adjusted  from  December  1,  1997  to  January  31, 1998 

•  an  updated,  system-wide  KPI  Contacts  list 

•  a  revised  and  updated  overview  of  the  KPIRS  program  classification  structure 

•  the  inclusion  of  updated  information  about  handling  special  situations  in  KPI  reporting  through 
CIS  in  the  main  body  of  the  manual  (formerly  in  an  appendix) 

•  a  table  ("Indicators  Apply  to")  in  each  indicator  section,  listing  the  indicators,  and  the  sectors  in 
which  each  indicator  applies;  and  a  "Data  Elements  &  Reporting  Systems"  table  indicating  the 
system  used  for  reporting  (or  calculating)  each  element 

•  a  summary  of  January  1999  reporting  requirements  for  Non-Credit  Programming  in  the  Access 
Indicators  section  with  further  elaboration  in  an  appendix 

•  University  Transfer  Program  Leavers  specifications  amended  to  capture  information  about 
"transfers"  to  degree-level  programs  at  Alberta  Colleges  and  Technical  Institutes 

•  the  "program  completion"  indicator  dropped  from  the  Transfer  Student  Performance  indicator  set 

•  a  table  "mapping"  the  response  scales  and  terms  for  Graduating  Student  Satisfaction  indicator  data 
to  the  categories  in  KPIRS 

•  data  definitions  and  classifications  for  Revenue  and  Expenditure-Related  indicators  revised  to 
correspond  directly  to  FIRS;  "Enterprise  Revenues"  and  "Institutional  Support  (Administration) 
Expenditure"  indicators  included 

Changes  since  November  28: 

■  KPI  Contacts  list  updated 

■  note  added  re:  Statistical  Adjustments  to  Graduating  Student  Satisfaction  and  Employment  & 
Academic  Outcomes  data  (pp.  53,  59) 

■  "Indicators  Apply  to"  table  corrected  to  show  the  indicators  reported  by  Private  Colleges  (p.  65) 

■  addition  re:  exclusions  for  Average  Course  Section  Size  calculations  for  Private  Colleges  (p.69) 

■  change  in  denominator  of  Enterprise  Revenues  indicator  to  parallel  that  used  for  "Progress  Rating" 
calculations  (pp.  86-88) 

■  change  in  definition  of  Institutional  Support  (Administration)  cost  indicator  to  parallel  that  used  for 
"progress  Rating"  calculations  (pp.  89-90) 

■  addition  of  Dalhousie,  Memorial,  Queen's  &  Sherbrooke  to  UofA  &  UofC  research  indicator  peer 
groups  (pp.  91,93,97,  101,  105) 

■  additions  and  clarifications  re:  UofL  reporting  of  Research  Impact  indicators  (pp.  105-107) 
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INTRODUCTION 


This  Manual 

This  manual  has  been  prepared  to  assist  institutions  with  assembhng  and  submitting  data  to 
system-wide  databases.  It  is  to  be  read  along  with  a  separate  publication:  Common  Terminology, 
Definitions,  and  Classifications. 

Data  Collection  Systems 

Various  data  collection  systems  are  used  to  ensure  consistency  in  reporting,  storing,  and  using 
data  across  Alberta's  post-secondary  system.  Each  of  these  systems  includes  both  manuals  and 
software: 

CIS  (Common  Information  System)  -  CIS  includes  two  components,  one  dealing  with 
enrolment  and  student  information,  and  the  other  dealing  with  program  information. 

FIRS  (Financial  Information  Reporting  System)  -  FIRS  includes  revenue,  expenditure  and 
tuition  fee  data  and  some  basic  information  on  facilities  and  staff. 

KPIRS  (Key  Performance  Indicator  Reporting  System)  -  KPIRS  uses  data  institutions  provide 
through  CIS  and  FIRS,  and  additional  data  institutions  enter  directly  into  KPIRS,  to 
calculate  agreed-upon  key  performance  indicators.  Only  those  institutions  that  use  CIS  are 
able  to  use  all  of  KPIRS'  reporting  capabilities. 

The  relationship  of  the  databases,  and  the  way  in  which  they  come  together  to  produce  KPI  data, 
is  shown  in  Illustration  1 . 

Each  of  the  reporting  systems  has  been  written  by  the  Information  Management  Branch  of  AECD 
and  is  provided  to  institutions  for  use  on  their  own  desktop  computers.  Institutions  need  to 
ensure  that  this  software  is  installed  on  equipment  that  meets  or  exceeds  the  minimum  operating 
requirements  as  specified  in  documentation  accompanying  the  software.  The  department 
provided  special  funding  to  the  institutions  to  ensure  that  they  have  the  appropriate  equipment. 

Further  integration  of  these  reporting  systems  took  place  during  1997  to  enhance  consistency  in 
reporting,  to  remove  duplication,  and  to  simplify  their  use.  To  this  end,  in  the  summer  of  1997, 
the  Learning  Support  and  Accountability  Division  created  a  new  Branch  that  brings  together  the 
major  data  collection  systems: 


System  Information  Branch 
Learning  Support  and  Accountability  Division 


Phone  415-2252  Fax:  427-5920 


Name 


Orton,  Larry 
Nicely,  Steve 


Gnanasihamany,  Tony 
Myshak,  Wendy 


Kashman,  Jean 
Malcolm,  Peter 
Holmstrom,  Linda 


Mills,  Trish 
Piche,  Kathy 


Jamani,  Zarin 
Selk,  Kathy 


Title 

Director 

Manager,  Enrolment  &  Student  Information 

Manager,  Program  Information 

Manager,  Financial  Information 

Information  Analyst 

Information  Analyst 

Information  Analyst 

[Seconded  from  AIT  Division] 

Project  Assistant 

Secretary 

Data  Administrator 


427-5630 
422-4847 
427-7146 
427-5633 
422-5054 
422-5050 
422-5052 
422-9235 
422-3103 
427-1819 
415-2255 


Phone 


E-mail  (x.x  @  aecd.gov.ab.ca) 

larry. orton 

Steve. nicely 

jean.kashman 

peter.malcolm 

linda.holmstrom 

trish.mills 

kathy.piche 

tony. gnanasihamany 

wendy  .myshak 

zarin.jamani 

kathy. selk 


Illustration  1 
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Flow  of  Institutions'  Data  into  System- Wide  Databases 


KPI  Database 


Key 
Performance 
Indicator 
Reporting 
System 

(KPIRS) 


Financial 
Information 
Reporting 
System 

(FIRS) 


i 

i  i 

Enrolment 
&  Student 
Information 

Program 
Information 

Alberta  Council 
on  Admissions 
and  Transfer 

(ACAT) 

Common 
Information 
System  (CIS) 

Institutions 


►    =  Data  Supply 
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These  specific  steps  towards  integration  have  been  taken: 

Reporting  Manuals  -  During  1997-98,  the  reporting  manuals  for  each  data  collection  system 
have  been  revised  so  that  the  definitions  common  to  various  indicators  and  across  sectors 
will  appear  in  a  "data  dictionary"  that  can  be  appended  to  the  reporting  manuals  for  all 
three  systems.  In  the  fall  of  1997  there  will  be  a  single  KPI  reporting  manual  for  all  sectors, 
and  it  will  contain  this  "data  dictionary".  Also  in  the  fall  of  1997,  the  same  "data 
dictionary"  will  form  part  of  the  FIRS  reporting  manual.  When  they  are  revised,  CIS 
reporting  manuals  will  include  the  same  data  dictionary. 

Software  -  All  three  data  collection  systems  have  been  re-written  in  "Visual  FoxPro"  and 
have  a  common  "front  end"  through  which  the  user  selects  which  application  to  run.  Most 
significantly,  provided  an  institution  installs  the  software  and  data  on  a  server,  it  will  be 
possible  for  several  users  to  access  one  or  more  of  the  applications  from  their  own  personal 
computer.  Data  entered  by  one  person  will  be  available  to  the  other  users. 

The  schedule  we  are  attempting  to  follow  for  collecting  data  and  distributing  information  is  given 
in  the  "Typical  Process"  table. 


Data  to  be  reported 


FIRS 

KPIRS 

Date  due 

Data  expected 

Date  due 

Data  expected 

Jan.  1998 

1995-  96  Actuals 

1996-  97  Actuals 

1997-  98  Forecast 

1998-  99  Plan 

1999-  00  Plan 

Jan.  1998 

1996-97  data.  Institutions  are  also 
asked  to  submit  any  data  outstanding 
from  previous  submissions. 

Nov.  1996 

1994-  95  Actuals 

1995-  96  Forecast/ Actuals 

1996-  97  Budget 

1997-  98  Plan 

1998-  99  Plan 

Dec.  1996 

1995-96 

June  1996 

1993-94  &  1994-95  Revenue  & 
Expenditure  data  only. 

Pilot  year 

1993-94  and  1994-95 

How  and  to  whom  data  is  reported 

When  institutions  are  ready  to  submit  either  FIRS  or  KPI  data  to  the  department,  they  can  either 
mail  or  courier  the  diskettes  or  they  can  e-mail  the  data  files  to: 

Kathy  Selk 

Data  Administrator 

System  Information  Branch 

Learning  Support  and  Accountability  Division 

10'^  Floor,  Commerce  Place 

10155  102  Street 

Edmonton,  AB  T5J  4L5 

voice  415-2255 

e-mail  kathy. selk@aecd.gov.ab.ca 
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Typical  Process 


Date 

CIS                 1             FIRS  KPIRS 

April 

Government  fiscal  year  runs  from  April  1  to  March  31. 
Institutions'  Business  Plans  are  due. 

June 

A  "System  Performance 
Report"  will  be  published. 

July 

CIS  July  (Academic  Year-end) 
submission  is  due  on  or  before 
July  31. 

Sept. 

Once  CIS  data  are  available, 
the  department  provides  lists  of 
students  to  the  seven  colleges 
with  University  Transfer 
programs.  This  starts  the  data 
collection  process  for  the  UT 
Leavers  indicators. 

Oct. 

Updates  to  CIS  data,  such  as 
late  graduates,  are  due  as  soon 
as  possible  after  the  academic 
year  ends,  but  no  later  than 
Oct.  15  to  ensure  inclusion  in 
KPIRS. 

Seven  colleges  with  UT 
programs  submit  their  UT 
"leaver"  file  to  ACAT.  All 
institutions  are  to  submit  DAD 
files  to  ACAT  by  October  30. 
The  department  will  extract 
some  information  for  the 
Demand/Capacity  indicator 
from  DAD  and  transfer  it  to 
KPIRS. 

Nov. 

Data  requested.  Any  necessary  software  upgrades  are  issued  by 
AECD  to  all  institutions,  along  with  any  revisions  to  reporting 
manuals. 

CIS  data  on  record  as  of 
October  30  are  transferred  to 
the  KPIRS  database. 

ACAT  will  report  UT  leaver 
results  to  institutions. 

Jan. 

FIRS  and  KPIRS  submissions  are  due  on  or  before  January  3 1 .  FIRS  and  KPIRS  data  should  be 
submitted  earlier  if  possible  to  allow  ample  time  for  the  department  to  determine  funding. 
CIS  data  (the  December  submission  for  the  academic  year  in  progress)  is  due  by  January  31. 

Feb. 

The  indicators  used  in  performance-based  funding  are  calculated. 

Listservers 

A  'listserver'  is  an  automated  method  for  exchanging  communications  among  a  group.  By 
addressing  a  message  to  just  one  location  (a  computer  'server')  you  are  able  to  send  the  message 
to  a  group  of  people  (the  'list').  Individuals  can  put  themselves  on  the  list  either  by  sending  a 
message  to  the  computer,  which  automatically  grants  'membership'  on  the  list,  or  by  asking  a 
person  who  maintains  the  list  for  'membership'  on  the  list.  Or  the  person  who  maintains  the  list 
can  enter  names  himself.  However  names  are  added,  any  message  addressed  to  the  server  is 
automatically  distributed  to  everyone  on  the  list.  The  use  of  listservers  has  been  of  enormous 
benefit  throughout  the  development  of  KPIs. 
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From  the  early  stages  in  the  KPI  project  Grant  MacEwan  Community  College  maintained  a 
listserver  to  facilitate  the  exchange  of  information  on  KPIs  among  the  Colleges  and  Technical 
Institutes.  That  Listserver  came  to  include  people  from  other  institutions  and  even  people  from 
other  jurisdictions  who  were  interested  in  the  work  being  done  in  Alberta.  The  University  of 
Lethbridge  provided  a  similar  service  on  behalf  of  the  universities,  although  that  system  focused 
on  CIS.  The  private  colleges  had  no  such  service  (although  some  joined  one  of  the  other 
listservers)  and,  instead,  relied  on  e-mail  exchange  among  one  another  and  the  department. 

As  important  as  the  listservers  have  been,  from  a  system  perspective  the  situation  has  not  been 
perfect.  They  have  tended  to  serve  particular  sectors  rather  than  the  system  as  a  whole;  there  is 
no  listserver  for  the  private  colleges;  and  addresses  on  some  listservers  -  especially  those  that  are 
fully  automated  -  are  not  kept  up-to-date.  In  short,  we  need  a  user  friendly,  efficient  way  of 
communicating  with  one  or  more  or  a  number  of  groups,  system-wide  as  well  as  sector  by  sector. 

The  department  is  now  able  to  develop,  coordinate  and  provide  necessary  maintenance  and 
support  for  a  "facility"  like  this.  Accordingly,  in  consultation  with  the  providers  of  these 
listservers,  in  early  December  1997,  the  department  will  be  using  its  own  listservers  to  facilitate 
communication  on  all  work  related  to  CIS,  FIRS,  and  KPIs.  The  exact  date  will  be  announced 
using  existing  Listservers.  In  particular,  the  department  will  ensure  that  the  listservers  includes 

•  each  institution's  contact  for  each  of  these  areas; 

•  each  institution's  contact  for  related  areas;  and  that 

•  addresses  are  either  up-to-date  or  deleted  (see  note  below). 
Others  are  welcome  to  join. 

To  maintain  the  Listservers,  there  will  be  a  distinction  between  institutions'  official  contacts  and 
others: 

•  Official  contacts  The  department  will  automatically  enter  the  names  of  each  institutions' 
contact  and  the  various  committees  that  are  named  by  presidents  to  deal  with  those  areas. 
Each  area  will  be  handled  along  these  lines: 

KPIs    We  will  include  the  KPI  contacts  and,  for  example,  the  universities'  joint  committees 
responsible  for  KPIs  and  the  Key  Performance  Indicators  Committee  appointed  by  the 
Council  of  Presidents  for  colleges  and  institutes. 

FIRS   We  will  include  the  FIRS  contacts.  Senior  Business  Officers,  and  Senior  Accounting 

and  Control  Officers. 
CIS     We  will  include  CIS  contacts. 

Because  they  are  sometimes  copied  on  matters  related  to  work  in  these  three  areas,  we  will 
set  up  separate  areas  for  Presidents,  Vice-Presidents,  and  Registrars. 

•  Others  are  encouraged  to  join  the  listserver  following  the  instructions  outlined  above. 
However,  if  you  move,  you  will  have  to  update  your  own  address.  If  the  Listserver  rejects 
your  addresses  more  than  two  or  three  times,  then  you  can  expect  to  have  your  name  removed 
from  the  Listserver. 
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To  join  or  to  quit  one  of  the  Listservers,  or  to  get  a  list  of  the  members  of  the  Listserver,  send 
the  message 

subscribe  kpi,      subscribe  cis,  or     subscribe  firs      to  join  the  listserver  of  your  choice 
unsubscribe  kpi,  unsubscribe  cis,  or  unsubscribe  firs  to  quit  the  list  of  your  choice^ 
who  kpi,  who  cis,  or  who  firs  to  get  a  list  of  subscribers 

and  in  each  case  address  the  message  to  majordomo@www.aecd.gov.ab.ca 

To  send  a  message  to  everyone  on  one  of  the  Listservers,  address  your  message  to  the  appropriate 
Listserver,  as  follows: 

for  the  KPI  listserver  KPI@www.aecd.gov.ab.ca 

for  the  CIS  Listserver  CIS@www.aecd.gov.ab.ca 

for  the  FIRS  Listserver  FIRS@www.aecd.gov.ab.ca 

The  Listservers  will  be  maintained  by 
Kathy  Selk 
Data  Administrator 
System  Information  Branch 
Learning  Support  and  Accountability  Division 
Telephone:  415-2255 
E-mail:  kathy. selk@aecd.gov. ab.ca 

Information  specific  to  KPIRS 

Since  KPI  data  is  obtained  somewhat  differently  for  each  indicator  set,  the  way  in  which  the  data 
is  obtained  is  explained  in  detail  in  the  section  of  the  KPI  Reporting  Manual  describing  each  set. 

Other  key  information  follows: 

•  When  the  KPIRS  software  is  ready,  it  is  distributed  to  institutions  once  their  CIS  data  is 
received  and  made  ready.  Institutions  whose  current  year  CIS  data  is  not  yet  ready  will 
receive  the  KPIRS  software  when  their  CIS  data  is  ready. 

•  The  KPIRS  software  distributed  in  the  fall  of  1997  (Version  5.0)  is  the  first  version  provided 
to  the  universities.  However,  since  the  universities  are  not  entirely  part  of  CIS  they  will 
receive  a  limited-functions  edition  able  to  report  only  data  that  is  not  dependent  on  CIS. 
Universities  will  receive  Excel  spreadsheets  to  report  data  elements  for  indicator  sets  which 
depend  on  CIS.  Universities  will  receive  software  that  allows  complete  reporting  just  as  soon 
as  they  are  part  of  CIS. 

•  Installation  instructions  and  information  on  computer  system  requirements  will  be  included 
in  a  User  Guide  with  the  KPIRS  software. 

•  Since  the  KPIRS  reporting  software  is  populated  with  information  taken  from  other  sources, 
the  accuracy  of  KPI  data  and  the  integrity  of  reporting  processes  depend  on  the  appropriate 
use  of  each  of  the  other  sources. 

•  Program  and  enrolment  information  can  only  be  submitted  through  CIS.  (Institutions  will, 
however,  be  able  to  enter  their  own  calculation  for  student  contact  hours  into  KPIRS.)  Any 


NOTE  that  this  will  not  work  if  the  subscriber  has  changed  addresses  as  the  mail  server  uses  the  From  address  to  attempt  an 
"unsubscribe". 
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changes  to  program  and  enrolment  information  must  be  made  through  CIS.  Thus,  institutions 
must  ensure  that  their  CIS  submission  is  prompt,  complete,  and  accurate.  The  department 
turns  around  official  CIS  reports  within  2-4  weeks,  assuming  the  data  is  received  in  good 
condition. 

•  Revenue  and  expenditure  information  can  only  be  submitted  through  FIRS.  Any  changes  to 
this  information  must  be  made  through  FIRS. 

•  It  is  not  necessary  to  wait  until  all  data  is  ready  before  submitting  the  diskettes  to  the 
department.  The  KPIRS  software  will  allow  you  to  select  the  data  elements  to  be  submitted. 

A  brief  history  of  each  data  collection  system  and  of  KPIs 

Each  of  the  data  collection  systems  involves  a  user  friendly  electronic  tool  for  institutions  to 
submit  data  in  a  consistent  way.  Use  of  these  tools  eliminates  data  entry  errors  at  AECD  and 
minimizes  the  duplication  of  data  entry.  The  system- wide  databases  that  are  created  enhance  the 
comparability  of  information  between  institutions  within  the  same  sector  and,  to  the  extent 
possible,  across  the  various  sectors  of  the  post-secondary  system. 

The  databases  make  it  possible  to  identify  trends  across  the  Alberta  post-secondary  system.  They 
also  makes  it  possible  for  the  department  to  answer  the  various  queries  that  need  to  be  dealt  with 
on  an  ongoing  basis. 

CIS  (Common  Information  System) 

In  1981  the  department  realized  that  there  was  room  for  improvement  in  the  quality  of 
information  on  students  and  programs  being  collected  from  colleges  and  institutes.  Work 
had  begun  in  the  department's  "Planning  Secretariat"  on  an  improved  system.  The 
database  being  used  as  a  "model"  was  Statistics  Canada's  University  Student  Information 
System  (USIS).  The  next  year,  Statistics  Canada  approached  the  department  because  it  had 
identified  the  same  problem  nationally.  Statistics  Canada's  request  that  the  department  help 
to  improve  the  data  being  provided  to  Statistics  Canada  by  Alberta  colleges  and  technical 
institutes  was  timely,  since  the  department  had  already  begun  work. 

In  the  summer  of  1982,  representatives  of  the  department  met  with  representatives  of 
colleges  and  institutes  to  discuss  how  to  improve  the  quality  of  their  data,  and  if  possible,  to 
encourage  institutions  to  submit  their  data  in  a  fashion  similar  to  the  universities.  Over  the 
next  year  and  a  half,  the  department  worked  with  a  committee  of  college  and  institute 
officials  (the  Senior  Student  Services  Officers)  to  come  to  an  agreement  on  a  new  database 
and  reporting  system.  At  the  end  of  those  discussions,  that  agreement  was  approved  by  the 
Council  of  Presidents.  A  Committee,  composed  of  representatives  of  the  public  colleges, 
technical  institutes,  and  the  department,  was  established  to  oversee  the  implementation  of 
CIS.  However,  the  colleges  and  institutes  didn't  begin  reporting  enrolment  through  CIS 
until  1989-90.  Since  then,  the  department  has  used  CIS  as  the  source  of  data  needed  by 
Statistics  Canada,  and  that  agency  has  not  had  to  deal  directly  with  Alberta's  colleges  and 
institutes.  In  this  way,  CIS  is  part  of  Statistics  Canada's  College  Post-Secondary  Enrolment 
and  Graduates  System  (CCSIS),  and  TradeA^ocational  Enrolment  System  (TVOC). 

From  the  outset,  it  was  the  department's  intention  to  include  Alberta's  universities  in  CIS. 
Discussions  with  the  universities  began  in  1987  and  reporting  was  to  begin  with  the  1991- 
92  academic  year.  Universities  are  expected  to  be  making  full  use  of  the  system  by  the  fall 
of  1998  and  to  provide  data  for  1991-92  through  1997-98. 
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IFIRS  (Financial  Information  Reporting  System) 

Since  the  department  was  created,  it  has  been  collecting  information  on  institutions'  actual 
and  projected  revenues  and  expenditures.  Initially,  the  information  was  collected  on  paper 
and,  more  recently,  using  computer  spreadsheets.  In  1995,  the  first  steps  were  taken  to 
create  a  database  and  reporting  software  and  the  initial  version  of  FIRS  was  released  in 
June  1996.  The  first  data  was  submitted  to  the  department  in  October  1996. 

FIRS  makes  it  possible  for  institutions  to  report  financial,  staffing,  tuition-fee  policy,  and 
capital  information  associated  with  their  multi-year  business  plans. 


KPIRS  (Key  Performance  Indicator  Reporting  System) 

Work  on  the  development  of  new  accountability  arrangements  was  marked  in  the  fall  of 
1993  with  the  distribution  of  a  discussion  document  prepared  by  Advanced  Education  and 
Career  Development.  The  department  invited  institutions  to  name  committees  with  which 
the  department  could  discuss  these  new  arrangements  and  the  development  of  performance 
indicators.  From  an  early  stage,  the  development  of  indicators  was  seen  as  a  long-term 
project  operating  in  several  phases:  "Phase  One"  involved  developing  and  piloting  a  basic 
set  of  indicators  using  pilot  data  for  the  1994-95  academic  year.  The  pilot  year  -  1995-96  - 
was  intended  to  give  both  the  institutions  and  the  department  a  chance  to  run  some  real  data 
through  the  system. 

The  1995-96  pilot  year  officially  got  underway  when  the  first  versions  of  a  manual  for  KPI 
reporting  were  distributed  in  September  1995.  The  data  collection  that  followed  identified 
a  number  of  problems.  The  scope  of  the  pilot  was  changed;  the  problems  were  resolved; 
the  manuals  were  revised;  and  reporting  software  was  added.  Revised  manuals  and 
reporting  software  were  distributed  in  May  1996  to  initiate  a  second  round  of  pilot  data 
collection.  The  second  round  of  the  pilot  raised  new  issues,  and  the  resolution  of  those 
issues  was  reflected  in  the  reporting  manuals  published  in  November  1996. 

Early  in  1996,  initial  work  on  KPI  development  for  private  colleges  was  suspended  to 
ensure  that  the  pilot  rounds  and  the  initial  year  of  start-up  phase  reporting  for  other  sectors 
were  successful.  This  had  some  practical  advantages  to  the  extent  that  the  KPIs  for  the 
private  colleges  are,  for  the  most  part,  a  sub-set  of  the  universities  indicators,  with  additions 
and  specializations  appropriate  to  the  private  college  sector.  Work  with  the  private  colleges 
resumed  in  the  spring  of  1997;  a  draft  manual  was  produced  and  pilot  and  start-up  years 
data  assembled. 

The  collection  of  "real"  data  began  with  the  publication  of  reporting  manuals  in  November 
1996.  These  manuals  documented  the  standards  institutions  and  the  department  had  agreed 
to  for  the  collection  of  publishable  data  for  the  1995-96  year.  During  that  same  year, 
institutions  were  asked  to  update  the  pilot  data  to  the  November  1996  Reporting  Manual 
standards. 
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Use  ofKPI  data 

This  data  has  been  reported  by  institutions  in  all  sectors  and  used  in  the  first  pilot  year  of 
implementation  of  the  Performance  Funding  Envelope.  The  full  data  set  for  all  institutions  has 
been  made  available  to  each  institution.  The  data  will  also  be  used  in  a  first  annual  system 
performance  report  expected  before  the  end  of  the  year.  Illustration  2  outlines  the  major  uses  of 
the  data  by  institutions  and  the  department. 


Illustration  2 
Use  of  KPI  Data 
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Future  Development  of  KPIs 

At  this  stage  in  our  work  on  KPIs,  a  number  of  major  projects  need  to  be  undertaken: 

•  Evaluating  and  making  improvements  to  the  indicators. 

•  Addressing  the  need  for  indicators  for  areas  considered  too  difficult  to  tackle  early  in  the 
project.  This  includes  matters  such  as  alternative  delivery,  brokering,  collaborative 
arrangements  and  community  service. 

•  Non-credit  or  continuing  education  programs  were  also  set  aside  originally;  they  were  the 
subject  of  a  year-long  consultation  with  all  institutions  during  the  1996-97  academic  year,  the 
results  of  which  are  included  in  this  manual. 

•  This  revision  of  the  manual  does  not  include  any  new  indicators.  Further  cooperative  work  is 
needed  to  reach  agreement  on  these. 

•  A  new  completion  rate  indicator  was  suggested  during  the  pilot.  Implementation  is  "on  hold" 
pending  decisions  about  the  addition  of  new  indicators. 

Auditing  data 

It  is  imperative  that  revenue  and  expenditure  data  submitted  through  FIRS  be  reconcilable  with 
the  audited  financial  statements.  CIS  data  is  carefully  checked  by  department  staff  and  the 
enrolment  data  is  subject  to  audit  by  the  provincial  Auditor  General.  KPI  data  -  in  particular,  that 
used  in  performance-based  funding  -  is  reviewed  by  the  Auditor  General  to  ensure  compliance 
with  reporting  methodologies  and  protocols  through  a  specified  procedures  audit.  Audit 
observations  and  recommendations  are  made  to  the  institutions  subject  to  audit,  and  to  the 
department. 
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KPI  CONTACTS 


Colleges 


Mr.  Arthur  Greenblatt 
President 

Alberta  College  of  Art  and  Design 
1407  -  14  Avenue  N.W. 
Calgary,  Alberta  T2N4R3 
Phone:  284-7639 
Fax:  289-6682 

e-mail :  arthur.germblatt @ acad.ab.ca 
Ms.  Jean  Madill 

Acting  Vice  President,  College  Services 

Grande  Prairie  Regional  College 

10726  -  106  Avenue 

Grande  Prairie,  Alberta  T8V  4C4 

Phone:  539-2097 

Fax:  539-2832 

e:mail:  jean.madill@gprc.ab.ca 

Mr.  Bryan  Husband 

Director,  Research  &  Planning 

Keyano  College 

8115  Franklin  Avenue 

Fort  McMurray,  Alberta  T9H  2H7 

Phone:  791-4852 

Fax:  791-4841 

e-mail:  bryan.husband@keyanoc.ab.ca 

Dr.  Leslie  Vaala,  Coordinator 

Institutional  Research,  Planning  &  Evaluation 

Lethbridge  Community  College 

3000  College  Drive  South 

Lethbridge,  Alberta  TIK  1L6 

Phone:  320-3268 

Fax:  329-0530 

e-mail:  vaala@lethbridgec.ab.ca 

Ms.  Lynda  Wallace-Hulecki 

Director,  Institutional  Analysis  and  Planning 

Mount  Royal  College 

4825  Richard  Road  S.W. 

Calgary,  Alberta  T3E  6K6 

Phone:240-6396 

Fax:  240-6040 

e-mail:  lhulecki@mtroyal.ab.ca 


Mr.  Ismal  Sutankayo 
Director,  Financial  Affairs 
Fairview  College 
Box  3000 

Fairview,  Alberta  TOH  ILO 
Phone:  835-6657 
Fax:  835-6698 

e-mail:  isutankayo@fairviewc.ab.ca 

Mr.  Alan  Vladicka 
Coordinator,  Institutional  Research 
Grant  MacEwan  Community  College 
Box  1796 

Edmonton,  Alberta  T5J  2P2 

Phone:497-5391 

Fax:  497-5405 

e-mail:  vladickaa@admin.gmcc.ab.ca 

Mr.  Garry  Garton 

Manager  of  Institutional  Research 

Lakeland  College 

Bag  5100 

Vermilion,  Alberta  TOB  4M0 
Phone:  853-8610 
Fax:  853-8601 

e-mail:  garry . garton @lakelandc.ab.ca 
Dave  Jones 

Director,  College  Services 
Medicine  Hat  College 
299  College  Drive  S.E. 
Medicine  Hat,  Alberta  Tl A  3Y6 
Phone:  529-3803 
Fax:  526-7750 

e-mail:  dwjones@acd.mhc.ab.ca 

Ms.  Sandy  Wilson 
Project  Coordinator 
Olds  College 
4500  -  50  Street 
Olds,  Alberta  T4H  1R6 
Phone:  556-8210 
Fax:  556-4698 

e-mail:  swilson @admin.oldscollege.ab.ca 
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Mr.  Tony  Skorjanc 
Institutional  Research  Officer 
Red  Deer  College 
Box  5005 

Red  Deer,  Alberta  T4N  5H5 
Phone:  343-4066 
Fax:  341-4899 

e-mail:  tskorjanc@admin.rdc.ab.ca 


Technical  Institutes 


Mr.  Bill  Spaans,  Director 
Research  &  Academic  Development 
NAIT 

11762-  106  Street 

Edmonton,  Alberta  T5G  2R1 

Phone:471-7008 

Fax:471-8583 

e-mail:  bills @nait.ab.ca 


Mr.  Chi-Fui  Chong 

Controller 

SAIT 

1301  -  16  Avenue  N.W. 
Calgary,  Alberta  T2M  0L4 
Phone:  284-8142 
Fax:  284-8158 

e-mail:  chifui.chong@sait.ab.ca 


Alberta  Vocational  Colleges 


Mr.  Doug  Bates 

Director,  Research,  Planning  &  College  Relations 

AVC  -  Edmonton 

10215  -  108  Street 

Edmonton,  Alberta  T5J  1L6 

Phone:  422-2775 

Fax:  427-5484 

e-mail:  dbates@edma.avc.calgary.ab.ca 

Mr.  Andre  Piquette 

Director,  Student  Services 

AVC  -  Lac  La  Biche 

9531  -94  Avenue 

Lac  La  Biche,  Alberta  TOA  2C0 

Phone:  623-5523 

Fax:  623-56655 

e-mail:  andre.piquette@avcllb.ges.aecd.gov.ab.ca 


Mr.  Peter  Johnson 

Dean  of  Student  and  Ancillary  Services 

AVC  -  Calgary 

332  -  6  Avenue  S.E. 

Calgary,  Alberta  T2G4S6 

Phone:  297-4085 

Fax:  297-4847 

e-mail :  pj ohnson  @  avc .calgary .ab .ca 

Ms.  Pamela  Witte 

Performance  Measures  Coordinator 

AVC  -  Lesser  Slave  Lake 

1201  Main  Street  S.E. 

Slave  Lake,  Alberta  TOG  ICO 

Phone:  849-8617 

Fax:  849-2570 

e-mail:  witte@grda.avc.calgary.ab.ca 


I  Universities  ~ 

Mr.  Rick  Powell,  Head 
Institutional  Analysis 
Athabasca  University 
Box  10,000 

Athabasca,  Alberta    T9S  1  Al 
Phone:  675-6220 
Fax:  675-6170 

e-mail:  rick@cs.athabascau.ca 


Dr.  Carl  Betke,  Director 
Strategic  Analysis 
University  of  Alberta 
1-16  University  Hall 
Edmonton,  Alberta    T6G  2J9 
Phone:  492-2650 
Fax:  492-6646 

e-mail:  carl.betke@ualberta.ca 
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Dr.  Doug  Shale,  Academic  Analyst 
Office  of  Institutional  Analysis 
Room  1017  Education  Tower 
University  of  Calgary 
2500  University  Drive  N.W. 
Calgary,  Alberta    T2N  1N4 
Phone:  220-4016 
Fax:  282-7221 

e-mail:  dshale@acs.ucalgary.ca 


Dr.  Dennis  W.  Domoney,  Director 
Institutional  Analysis 
University  of  Lethbridge 
4401  University  Drive 
Lethbridge,  Alberta  T1K3M4 
Phone:  329-2062 
Fax:  329-2097 
e-mail:  domodw@hg.uleth.ca 


I  Private  Colleges 

Dr.  David  W.  Dahle,  Interim  Academic  Dean 

&  Vice-President  for  Academic  Affairs 

Augustana  University  College 

4901  -46  Avenue 

Camrose,  Alberta  T4V  2R3 

Phone:  679-1102 

Fax:  679-1129 

e-mail:  dahld@corelli.augustana.ab.ca 

Mr.  Merton  Sprengel,  Statistician 

Canadian  Union  College 

235  College  Avenue 

College  Heights,  Alberta  T4L  2E5 

Phone:  782-3381 

Fax:  782-3170 

e-mail:  msprenge@cauc.ab.ca 


Rev.  Richard  Kraemer,  President 
Concordia  University  College  of  Alberta 
7128  Ada  Boulevard 
Edmonton,  Alberta    T5B  4E4 
Phone:  479-8481 
Fax:  474-1933 

e-mail:  rkraemer@concordia.edmonton.ab.ca 


Dr.  Keith  Ward,  Vice-President 

The  King's  University  College 

9125-50  Street 

Edmonton,  Alberta  T6B  2H3 

Phone:  465-3500 

Fax:  465-3534 

e-mail:  skward@kingsu.ab.ca 


Ms.  Marilyn  Patton,  Executive  Officer 
Private  Colleges  Accreditation  Board 
Room  430,  108  Street  Building 
9942  -  48  Street 
Edmonton,  Alberta  T5K  2J5 
Phone:  427-8921 
Fax:  427-0423 

e-mail :  marilyn. patton @ aecd.gov.ab.ca 
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KPIRS:  An  Overview  of  its  Program  Classification  Structure  and 

Reporting  Levels 

The  program  classification  strucmre  in  KPIRS  is  extracted  from  the  CIS  program  classification.  This 
structure  provides  the  basis  for  entering  data  at  any  level  of  aggregation.  The  illustration  below  describes 
the  available  levels  of  reporting,  from  the  highest  -  the  Institution  level  -  to  the  more  detailed  Program 
level.  Institutions  are  expected  to  enter  their  KPI  data  at  the  appropriate  level,  as  defined  for  each 
Information  Set  in  this  Manual. 

REPORTING  LEVEL 


Institution  Level 

[-1    Information  representing  the  institution  as  a  whole;  may  be  a  sum  or  roll-up  of  data  entered  at 
one  of  the  more  detailed  levels  described  below. 

Faculty  /  Administrative  Unit 

Usually  the  first  level  of  organizational  classification  below  the  "institution"  level.  What  is 
XX   called  "division"  at  one  institution  may  be  called  "department"  or  "faculty"  at  another.  This  is 
the  unit  charged  with  teaching  the  Program. 

Program  Type  (See  Table  1  for  details  of  Program  Types) 

A  level  of  classification  that  groups  programs  by  the  level  and  type  of  credential  awarded, 
JJ^   Certificate,  Diploma,  Degree,  etc. 

Subject  Area  (See  Table  2  for  details  of  Subject  Areas) 

r-j    A  grouping  of  programs  by  the  content  of  smdy  using  the  CIS  3-digit  Program  Classification 
<>  Codes. 

Standard  Name  and  Program  Length 

The  name  of  a  "program",  standardized  across  the  province  to  refer  to  similar  programs  that  have 
4J-   differing  names  from  institution  to  institution,  e.g..  Office  Administration  covers  Secretarial 

Science,  Clerk  Typist,  Administrative  Assistant,  Executive  Office  Assistant  and  others.  Standard 
Name  is  used  with  Program  Length  to  group  similar  programs,  and  is  the  basic  "program"  level 
used  for  KPI  reporting  for  the  universities,  private  colleges,  and  vocational  colleges. 

Program  (ProgID) 

"Program"  corresponds  to  the  CIS  ProgID  level  used  for  enrolment  reporting.  The  ProgID  as  the 
basic  "program"  level  for  KPI  reporting  by  the  Colleges  and  Technical  Institutes. 


Cross-Reference  Program  Identifier  (CIS  XrefID  level) 

Used  to  identify  programs  in  cases  where  the  program  has  more  than  one  ProgID.  Separate 
ProglDs  may  refer  to  separate  streams,  majors,  versions,  years  or  types  of  delivery  of  one 
program.  NOTE  The  XrefID  is  part  of  the  program  structure  that  comes  from  CIS.  The  current  version  of  KPIRS 
will  not  allow  institutions  to  enter  data  or  to  create  reports  at  this  level.  In  a  future  version  of  the  software, 
institutions  will  be  able  to  produce  reports  at  the  XrefID  level  which  roll  up  data  from  the  ProgID  level.  The  system- 
wide  database  already  allows  data  to  be  rolled  up  and  reported  at  the  XrefID  level.  In  this  way  the  database  can 
consistently  produce  data  that  corresponds  to  a  "program"  at  an  institution,  whether  the  program  is  normally 
identified  by  a  ProgID,  XrefID  or  a  Standard  Name. 
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Table  1:  CIS  Coding  to  Produce  KPI  Program  Type  Classifications 


KPI  Program  Type 

r  dl  Ulllllt;ill 
1  QQf)-Q7 

Type  or  Level  of  Qualification 

PU 

Preparatory  &  Basic  Upgrading 

na 

[Qualif  =  (10  OR  1 1  OR  12  OR  19  OR  21  OR  31  OR  32) 
AND  (Class  Code  >=  700000  AND  <720000)] 

SK 

Skill  Training* 

Certificate  /  na 

[Qualif  =  (10  OR  1 1  OR  12  OR  24  OR  29)  AND  (Class 
Code<700000)  AND  (Standard  Name  oUnclassified)] 

TC 

Trade  Certificate 

Certificate 

[Qualif  =  1 3  AND  AECD  Type  =  "TC"] 

AP 

Apprenticeship 

na 

[Qualif  =  18] 

C 

Certificate 

Certificate 

[Qualif  =  (13  OR  23)  AND  AECD  Type  NOT  "TC"] 

D 

Diploma 

Diploma 

[Qualif  =  14  OR  15] 

OC 

Other  Career**  [Post-Certificate] 

Diploma 

[Qualif  =  16  OR  22] 

UT 

University  Transfer 

na 

[Qualif  =  20] 

AD 

Applied  Degree 

Pipnr^p 

[Qualif  =  43] 

UG 

Bachelor  Degree 

Degree 

[Qualif  =  41 ,  42,  44,  45] 

MS 

Masters  Degree 

Degree 

[Qualif  =  51  OR  52  OR  53  OR  54] 

PD 

PhD 

Degree 

[Qualif  =  55] 

GS 

General  Studies 

na 

[(Qualif  =  10  AND  Class  Code  >=720000)  OR  (Standard 
Name  =  Unclassified  OR  Graduate-Qualifying  OR 
Graduate-Unclassified  OR  Graduate-Probationary)] 

*  Includes  short  trade,  pre-emp,  JU,  other  skill  training;  only  Qualif=24  are  "parchment'. 
**  Could  be  combined  with  Diploma 
Note:  "Parchment  1996-97"  are  the  programs  that  make  up  the  parchment  set  for  96-97  KPI  reporting. 
KPI  Program  Type  groups  programs  by  the  level  and  type  of  credential  awarded. 

KPI  Subject  Area  groups  programs  by  the  content  of  study  using  the  CIS  3-digit  Program  Classification  Codes. 


Table  2:  CIS  Coding  to  Produce  Subject  Area  Classifications 


Subject  Area 

CIS  3-Digit  Program  Class  Codes 

AE 

Architecture  and  Environmental  Design 

121, 126 

AG 

Agricultural  (and  related) 

230-237 

AS 

Arts  and  Science  (General) 

100-1 10,  700,  720,  722,  723,  725,  730 

BL 

Biological  and  Other  Life  Sciences  Related 

200,  220-229,  240-243 

BU 

Business  (and  related) 

600-625  (NOT  615) 

CM 

Communications  (and  related) 

510-514  and  516 

ED 

Education  (and  related) 

310-312,420-426 

FP 

Fine  and  Performing  Arts 

520-528 

HE 

Health  Related  (Not  Incl.  MD) 

300,  314,  330-333,  340-344,  360-363 

HS 

Humanities  and  Social  Sciences 

400-416,  500,  530-539 

IT 

Information  Technology 

113,515,  640-642 

MD 

Medicine  and  Dentistry 

320-328,  350-354 

MP 

Math  and  Physical  Sciences 

111-112,  115-117 

RR 

Renewable  Resources 

210-214 

SH 

Services  and  Hospitality 

313,  615,  630,  631,  633-637 

SS 

Social  and  Community  Services 

430-434,  440-444 

CE 

Civil  (engineering  and  related) 

120,122,123,124,125,  127  (NOT  121,126) 

CR 

Chemical  and  Resources  Related 

130-134 

EE 

Electrical  and  Electronics  (engineering  and  related) 

140-145 

EG 

Engineering  General  (and  related) 

160-163 

ME 

Mechanical  (engineering  and  related) 

150-154 

TR 

Transport  (and  Related) 

155,  156,  632 

AC 

Academic  Upgrading 

710,  713 

CP 

College/University  Preparation 

715 

ES 

English  as  a  Second  Language 

712 

JL 

Job  and  Life  Skills  Training 

711 

VP 

Vocational  Preparation 

714 

UC 

Unclassified  *** 

[Standard  Name  =  Unclassified]  OR  724 

*"  This  subiect  area  should  be  assigned  before  the  other  areas. 
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KPI  Data  from  the  Common  Information  System  (CIS) 


The  Role  of  CIS  in  KPI  Reporting 

CIS  Student  Data  is  the  source  for  all  or  part  of  the  data  elements  in  the  following  KPI  Information  Sets: 
Access,  Completion,  Transfer,  Cost  per  Student,  Cost  per  Graduate,  Employment,  Satisfaction,  and 
Demand  and  Capacity.  The  Program  Classification  structure  (see  Page  16)  used  in  the  KPI  reporting 
system  is  derived  from  program  classification  features  used  in  CIS  Program  Data. 

Program  Level  Reporting  for  KPIs 

Several  KPI  Information  Sets  involve  reporting  data  at  a  "program"  level.  Beside  CIS,  the  sources  for 
program  level  data  are  the  Alberta  Council  on  Admissions  and  Transfer  (ACAT)  and  the  institutions  [see 
illustration  on  Page  2].  In  CIS  the  basic  level  for  reporting  program  information  is  the  Program  Identifier 
(ProgID)  level.  At  an  institution  a  ProgID  may  refer  to  an  entire  program  or  to  a  single  component, 
stream  or  version  of  a  program.  Examples  of  the  latter  are  co-op  streams,  alternative  Year  2  majors, 
common  first  year,  and  alternate  delivery  offerings. 

When  the  department  needs  to  publish  reports  using  data  appropriate  to  a  higher  level  in  the  program 
structure,  such  as  Subject  Area  or  Program  Type,  the  data  is  generated  by  aggregating  the  ProgID  level 
data.  For  this  reason,  institutions  must  report  program  level  KPIs  at  the  CIS  ProgID  level.  (There  are 
exceptions  when  Standard  Name  is  used  for  the  program,  as  is  the  case  in  Preparatory  &  Basic 
Upgrading,  and  University  Transfer,  for  example).  Universities  will  report  most  program  data  at  the 
Standard  Name  level  until  they  are  using  CIS.  Data  can  not  be  entered  in  KPIRS  by  institutions  at 
the  XrefID  level.  Where  necessary,  institutions  should  pro-rate  higher  level  data  to  make  allocations  at 
the  ProgID  level. 

Data  in  the  Common  Information  Area  of  KPIRS 

The  common  information  area  of  KPIRS  will  contain  data  extracted  or  calculated  from  the  CIS  Program 
and  Student  Databases.  The  resulting  KPI  information  includes  unduplicated  headcounts,  FLEs,  Student 
Contact  Hours,  and  completer  counts  for  every  ProgID.  The  data  is  aggregated  and  stored  at  each  of  the 
higher  levels  in  the  program  classification  structure  and  is  available  as  needed  to  feed  into  other  KPI 
Information  Sets  or  to  be  provided  to  users. 

Completion  Data  for  Student  Tracking 

The  "Completion"  information  set  involves  identifying  an  entry  cohort  for  each  program  and  tracking 
students  until  they  complete  the  program  or  through  as  many  years  of  available  CIS  data  as  is 
appropriate.  This  is  a  complex  procedure  that  uses  CIS  data  but  builds  a  separate  data  system  to  manage 
the  tracking.  In  any  reporting  year,  completion  rate  data  will  be  generated  for  several  year's  entry 
cohorts.  For  example,  in  2001-02  when  reporting  for  the  2000-01  reporting  year,  there  will  be  some  4- 
year  programs  with  a  94-95  entry  cohort  that  are  being  reported  for  the  final  time  after  seven  years  of 
tracking.  By  this  time  KPIRS  will  contain  a  full  set  of  final  completion  rates  for  all  programs  that  had 
94-95  entry  cohorts. 

Special  Situations  in  KPI  Reporting:  Use  of  CIS  in  Collecting  Information 

CIS  handles  enrolment  reporting  for  several  special  situations.  The  sections  3-5  below  correspond  to 
Understandings  in  the  1989  Enrolment  Reporting  Manual,  November  1996  version.  This  manual  is 
available  for  downloading  from  the  department's  website  at  www.aecd.gov.ab.ca/sojtware.  While  the 
relevant  information  can  now  be  handled  in  the  latest  version  of  CIS,  changes  may  eventually  be 
necessary  to  more  effectively  meet  various  needs  that  arise  within  the  department  and  around  the  system. 
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KPI  reporting  is  one  such  case,  where  refinement  of  current  indicators  and  development  of  further 
indicators  may  require  new  distinctions  to  be  made  in  CIS  student  and  program  data. 

1.  Capturing  brokered  delivery ^  alternate  delivery  and  work  experience  activities 

The  initial  set  of  Key  Performance  Indicator  areas  agreed  to  for  Phase  1  of  the  KPI  reporting  process  did 
not  include  separate  indicators  to  capture  activities  in  these  areas.  Nor  has  the  department  or  the 
institutions  come  up  with  needed  refinements  of  the  initial  indicators  to  separate  out  data  on  these  special 
situations  from  the  overall  data. 

Further  development  has  been  moved  into  the  next  phase  of  KPI  development.  Phase  2  includes  the  first 
year  of  "live"  reporting  of  the  initial  set  of  indicators,  development  of  indicators  for  topics  not  included 
in  Phase  1  for  any  of  a  number  of  reasons,  and  work  to  refine  existing  indicators  so  that  the  impact  of 
these  special  situations  can  be  properly  described  and  evaluated. 

The  first  step  in  describing  and  evaluating  the  significance  of  brokering,  alternate  delivery  and  work 
experience  is  to  collect  some  basic  information  on  the  extent  of  involvement  by  institutions  in  these 
activities.  CIS  has  been  modified  to  begin  to  address  the  need  for  "common  information". 

2.  Reporting  brokered  and  collaborative  programs 

The  issue  of  how  to  handle  brokered  programs  has  come  up  throughout  the  KPI  development  process  to 
date.  The  department  has  decided  to  allow  both  institutions  involved  in  a  brokered  delivery  arrangement 
to  count  the  enrolments  for  use  in  indicators  for  the  annual  performance  funding  calculations.  Although  it 
may  be  some  time  before  this  is  a  totally  automated  process  using  CIS  and  KPIRS,  the  department  has 
implemented  some  changes  to  CIS  for  1996-97  to  enable  information  on  the  extent  of  brokering, 
including  the  FLE  enrolment  involved,  to  be  included.  Further  modifications  are  being  made  for  1997-98 
following  the  commitment  to  allow  institutions  to  share  the  enrolment  in  brokered  programs. 

Prior  to  1996-97,  brokered  activities  were  to  be  reported  through  CIS  only  in  cases  where  the  institution 
has  enrolment  that  it  is  authorized  to  count.  Changes  were  made  to  CIS  reporting  guidelines  to  stipulate 
how  hosting  institutions  are  to  report  enrolment  in  brokered  programs  both  for  official  counting  or  for 
KPI  purposes.  The  changes  enable  the  department  to  treat  the  students  in  brokered  programs  as  being 
"shared"  when  this  is  appropriate,  such  as  in  KPI  comparisons  and  the  funding  mechanism  Report  Card. 
By  enabling  institutions  to  report  through  CIS  on  all  brokered  activities,  an  information  base  will  be  there 
for  analyzing  brokered  program  issues. 

3.  Definition  of  brokered  and  collaborative  programs 

Increasingly,  institutions  are  cooperating  with  each  other  to  deliver  programs.  Two  of  the  approaches  - 
brokering  and  collaborative  arrangements  -  present  a  challenge  to  the  system  of  enrolment  counting.  A 
third  approach  to  cooperation  in  delivery  -  articulated  transfer  arrangements  -  will  be  mentioned  though 
it  presents  no  particular  problems  in  counting  students. 

•  In  a  brokering  arrangement,  an  institution  that  owns  or  is  responsible  for  a  program  [the 
credentialing  or  sponsoring  institution]  enters  into  an  agreement  with  one  or  more  other  institutions 
[the  hosting  or  brokering  institution].  The  hosting  institution  offers  all  or  part  of  the  program  but 
does  not  count  the  students  unless  it  has  secured  an  agreement  to  that  effect  with  the  credentialing 
institution.  The  program  is  typically  one  that  has  been  approved  by  the  government  but  the  brokering 
arrangement,  and  any  agreement  to  share  enrolment,  is  made  between  the  institutions  and  does  not 
require  formal  approval.  The  participating  institutions  need  to  notify  the  department  about  the  terms 
of  the  agreement. 

•  In  a  collaborative  arrangement,  two  or  more  institutions  obtain  joint  approval  of  the  government  to 
share  ownership  or  responsibility  for  a  program.  Approval  implies  that  the  operating  grants  of  each 
partner  can  be  expended  on  its  share  of  the  delivery  and  that  each  partner  counts  the  students  that  are 
attending  that  institution.  Successful  students  at  one  partner  are  promoted  to  the  next  stage  of  the 
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program  at  another  partner.  [In  collaborative  degree  programs,  such  as  the  nursing  programs  in 
Calgary  and  Southern  Alberta,  only  the  university  partner  can  award  the  degree  even  though  the 
students  are  counted  by  a  college  when  they  attend  there.] 

•  In  an  articulated  transfer  arrangement,  the  cooperation  involves  each  partner  delivering  its  own 
program.  [2  +  2  degree  completion  arrangements  are  an  increasingly  common  occurrence.]  The 
agreement  is  that  completion  of  one  program,  or  the  credits  earned  therein,  entitles  the  student  to 
advanced  standing  in  the  target  program.  The  student  has  to  apply  to  be  admitted  to  the  target 
institution.  Each  partner  counts  the  students  in  its  own  programs.  This  is  typical  of  University 
Transfer  programs.  [The  University  of  Alberta  nursing  programs  in  Edmonton,  Red  Deer,  Keyano, 
and  Grande  Prairie  are  also  examples  of  articulated  transfer.  The  model  also  involves  brokering  of 
the  upper  years  of  the  program  to  the  colleges.] 

Counting  the  students  in  brokered  and  collaborative  programs  for  official  enrolment  reporting  purposes  is  ^ 
a  straightforward  matter.  The  existing  guideline  for  official  enrolment  reporting  via  the  Common 
Information  System  is  that  enrolment  is  counted  by  the  institution  "responsible"  for  the  program,  unless 
the  parties  reach  an  agreement  to  divide  up  the  enrolment  [This  agreement  allows  the  hosting  institution 
to  officially  count  its  share  of  enrolment.  Procedures  for  reporting  are  the  same  as  for  other  programs.] 

The  following  reporting  guidelines  [in  the  1989  Enrolment  Reporting  Manual]  describe  how  each  type  of 
cooperation  is  reported  for  official  enrolment  counting  purposes. 

•  In  a  brokering  arrangement,  by  default,  the  hosting  institution  does  not  count  the  enrolment,  unless  it 
has  negotiated  an  agreement  with  the  credentialing  institution  to  share  the  enrolment.  It  is  up  to  the 
institutions  to  work  together  on  these  matters  and  inform  the  department  of  the  agreement. 

•  In  a  collaborative  arrangement,  by  default,  the  enrolment  is  shared  by  the  partners  by  virtue  of  the 
agreement  establishing  the  joint  delivery  of  the  program,  unless  the  partners  agree  to  another  way  to 
divide  up  the  enrolment  and  so  inform  the  department. 

•  In  an  articulated  transfer  arrangement,  each  institution  counts  its  own  students. 

The  remainder  of  this  section  describes  how  CIS  is  used  to  help  keep  track  of  all  program  offerings  that 
involve  brokering  or  collaboration.  There  is  a  need  to  identify  and  describe  all  cooperation 
arrangements,  whether  for  official  counting  or  for  KPI  purposes,  so  that  as  the  appropriate  protocols  are 
developed,  enrolment  and  completion  counts  can  be  shared  as  needed  by  the  cooperating  institutions  to 
report  on  program  costs  linked  to  student  outcomes  such  as  earned  FLE  ,  completion,  satisfaction, 
employment,  etc. 

Understanding  #12  -  CIS  Enrolment  Reporting  Manual 

There  are  two  aspects  to  using  CIS  for  indicating  involvement  in  brokered  and  collaborative  programs.  All 
institutions  involved  in  a  brokering/collaborative  arrangement  are  responsible  for 

i)  identifying  and  describing  the  programs  where  there  is  officially  recognized  involvement  in  and  responsibility  for 
brokering  or  collaborative  activities,  so  that  official  FLE  and  completion  counts  can  be  determined; 

ii)  signaling  those  arrangements  where  the  involvement  is  not  fully  recognized  in  the  official  enrolment  data.  In 
these  instances  one  institution  may  need  to  "borrow"  for  KPI  reporting  purposes  FLE  and  completion  counts  that 
are  not  being  officially  credited  to  the  institution. 

Item  (i)  is  reported  primarily  within  the  Special  Arrangements  section  of  the  CIS  Program  System.  One  part  of 
another  section  -  Program  Delivery  -  is  also  involved.  This  information  serves  to  describe  the  arrangements  for  a 
brokered  or  collaborative  program  for  which  the  institution  is  officially  entitled  to  report  students  in  CIS. 

Item  (ii)  is  signaled  in  the  Program  Identification  section  of  the  Program  System.  A  new  field  "Shared  FLE"  has 
been  added.  This  is  a  flag  that  signals  an  institution's  involvement,  as  part  of  a  brokering  or  collaborative 
arrangement,  in  a  program  belonging  to  another  institution.  The  program  in  question  needs  to  have  a  ProgID  in  the 
Look-Up  Table  for  the  academic  year.  The  ProgID  should  be  the  same  as  the  one  used  by  the  credentialing 
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institution  in  its  CIS  Program  Look-Up  Table.  In  addition,  descriptive  information  on  the  brokering  arrangement  is 
to  be  reported  in  the  Special  Arrangements  section  as  described  in  Item  (i). 

The  presence  in  your  data  of  a  "Shared  FLE"  flag  for  a  ProgID  that  belongs  to  a  credentialing  institution  signals  to 
the  department  the  following: 

•  your  institution  has  incurred  expenditures  for  a  program  for  which  it  does  not  have  the  prime  responsibility; 

•  your  institution  is  not  officially  allowed  to  count  students  or  eventual  completions  that  in  the  future  you  may  need 
to  report  for  KPI  or  funding  purposes. 

Up  until  now,  involvement  in  brokering  arrangements  where  no  official  enrolment  was  being  counted  was  reported  to 
the  department  on  an  annual  basis  in  a  paper  report  called  "Report  of  Other  Brokering  Arrangements". 

4.  Reporting  alternative  delivery  offerings 

Issues  related  to  alternative  delivery  cut  across  almost  all  of  the  Key  Performance  Indicators.  There  is 
the  perennial  issue  of  the  costs  and  benefits  of  using  alternate  modes  of  delivery,  especially  those  that  are 
expensive  to  set  up  and  slow  to  produce  results.  As  well,  students  in  these  offerings  have  fewer  contact 
hours,  use  less  physical  space,  require  less  staff  involvement,  etc.  Some  institutions  are  moving  very 
rapidly  to  expand  the  use  of  alternate  modes,  including  hooking  up  with  other  providers  over 
telecommunication  links  and  sharing  resources  and  students.  [Here  the  alternate  delivery  issue  overlaps 
with  the  brokered  program  issue.] 

Most  of  the  issues  related  to  alternate  delivery  have  not  been  addressed  by  the  various  committees 
looking  into  these  questions.  Due  to  time  limitations  and  the  complexity  of  the  area,  details  on  new  and 
refined  indicators  that  adequately  capture  the  use  of  alternate  modes  of  delivery,  including  distance 
education  technologies,  have  had  to  be  postponed.  To  develop  and  test  measures  that  recognize  alternate 
delivery  will  require  basic  enrolment  data  to  indicate  the  extent  of  activity  in  this  area.  CIS  has  been 
modified  to  begin  to  collect  this  sort  of  basic  information. 

Understanding  No.  13  -  CIS  Enrolment  Reporting  Manual 

Alternate  delivery  is  playing  an  increasing  role  in  providing  adult  learners  with  opportunities  to  access  post- 
secondary  programs.  The  costs  and  benefits  of  various  modes  of  delivery  will  be  analyzed  and  debated  for  some 
time.  This  will  be  a  key  issue  in  program  costing  and  evaluation.  For  these  purposes  it  is  necessary  to  know  how 
many  students  are  participating  through  alternate  modes  of  delivery  and  how  much  FLE  enrolment  is  being 
generated. 

There  are  3  aspects  to  using  CIS  to  indicate  the  involvement  of  programs,  and  the  participation  of  students,  in 
alternate  delivery  offerings.  [The  plan  for  the  immediate  future  is  to  adapt  CIS  in  its  current  form  to  capture 
information  on  students  enrolled  in  programs  offered  through  one  or  another  modes  of  alternative  delivery.  In  the 
longer  term  it  may  be  desirable  to  modify  CIS  to  make  reporting  on  alternative  delivery  more  convenient.] 

i)  Identify  the  programs,  or  versions  of  programs,  where  the  curriculum  is  being  offered  in  whole  or  in  part  [at  least 
one  complete  course]  through  any  of  several  modes  of  alternate  delivery.  [This  excludes  cases  where  technology 
is  used  as  an  aid  to  delivering  just  part  of  a  course.] 

ii)  Identify  the  type  of  delivery  —  the  mode  and  setting  used  for  the  delivery. 

iii)  Identify  when  a  student  is  registered  in  alternate  mode  offerings  of  a  program  and  record  the  student  as  attending 
an  "alternative  delivery"  campus  using  an  appropriate  campus  code 

Item  (i)  is  indicated  by  the  specific  ProgID  and  Campus  of  the  alternate  delivery  offering.  [The  ProgID  and  Campus 
code  are  also  used  on  the  student's  record  to  identify  the  student's  program  of  study.]  Depending  on  the  extent  to 
which  the  entire  curriculum  of  a  program  is  offered  in  alternate  mode:  use  a  separate  ProgID  to  identify  when  a 
program  is  available  in  its  entirety  via  an  alternate  mode  OR  use  a  separate  Campus  code  ["Alternate  Delivery"  or 
"Distance  Delivery",  for  example]  to  identify  the  alternate  mode  portion  of  a  program  offered  in  mixed  mode. 

Using  a  separate  ProgID  would  be  similar  to  cases  where  a  common  first  year  of  study  is  reported  separately  from 
the  several  diploma  streams  that  are  followed  during  year  two  of  the  program.  The  XreflD  is  what  links  all  these 
ProglDs  into  one  broad  program  and  can  serve  to  capture  the  entire  program  for  special  reporting  purposes. 

The  use  of  a  special  Campus  code  is  for  situations  in  which  a  segment  of  a  program  is  offered  through  an  alternate 
mode,  which  means  a  student  could  in  one  session  take  a  combination  of  courses  involving  the  two  modes.  The 
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combined  identifier  "ProglD-Campus",  using  the  special  Campus  code  for  "alternate  delivery"  serves  to  signal  that 
the  student  is  engaged  in  the  alternate  delivery  portion  of  a  program  offered  also  in  traditional  mode.  A  student 
taking  both  classroom  based  and  alternate  delivery  courses  in  the  same  program  would  need  to  have  2  CIS  records 
for  the  session.  The  student  would  in  effect  be  on  separate  "campuses"  for  the  two  activities.  This  is  a  case  where  it 
is  acceptable  to  report  the  student  using  two  records  for  the  same  program  during  the  same  session.  See  also 
Understanding  No.  2. 

Item  (ii)  is  reported  in  the  Program  Delivery  section  of  the  CIS  Program  System.  The  element  Type  of  Delivery 
applies  to  each  ProgID,  and  separately  to  each  Campus  if  the  program  is  offered  at  several  campuses  or  in  several 
alternate  modes  -  for  example,  if  there  is  both  an  internet  based  and  a  correspondence  based  format  for  delivery  of 
the  program.  It  is  used  to  describe  the  primary  mode  of  delivery  and  the  nature  of  the  setting  in  which  the  program  is 
offered,  e.g.,  on  or  off  campus,  to  individuals  or  to  groups  of  students. 

Item  (iii)  is  reported  in  the  Student  System  using  the  field  Registration  Type.  As  an  example,  where  a  student  is 
taking  a  sessional  course  load  that  includes  9  credits  in  alternate  delivery  mode  out  of  15,  the  9  credit  load  is 
reported  in  a  student  record  that  reports  a  code  of  "D"  in  Registration  Type.  This  coding  is  used  in  conjunction  with 
appropriate  codes  in  the  Campus  field  and  in  the  Program  Delivery  section  as  described  in  (i)  and  (ii)  above.  The 
student  would  have  a  second  student  record  for  the  same  session  for  reporting  the  remaining  6  credits  in  traditional 
classroom  mode.  The  normal  Campus  code  would  be  used  for  the  traditional  mode  segment  of  the  program  in  both 
the  Program  and  Student  Data  records.  The  special  Campus  code  for  "alternate  delivery"  would  be  used  for  the 
alternate  mode  segment. 

The  combination  of  "ProglD-Campus"  used  to  identify  the  student's  program  and  mode  of  delivery  on  the  two 
student  records  would  enable  the  student's  FLE  for  alternate  delivery  to  be  separated  from  the  FLE  earned  through 
traditional  delivery.  In  cases  where  the  student  is  taking  all  the  credits  through  an  alternate  mode,  only  one  student 
record  would  need  to  be  reported.  The  standard  CIS  Table  1  Enrolment  Report,  when  run  for  all  campuses,  would 
serve  to  produce  the  FLE  for  an  "alternate  delivery"  campus  that  summarized  the  FLEs  of  all  programs  offered  via 
alternate  delivery. 

5.  Reporting  programs  with  a  major  work  experience  component 

Programs  that  involve  a  work  experience  component  continue  to  increase  in  number.  A  few  years  ago  a 
department  report  on  Programs  with  Work  Experience  found  there  were  approximately  30,000  students 
in  such  programs,  15,000  at  the  universities.  The  Access  Fund  has  stimulated  further  expansion  of  work 
experience  opportunities  by  funding  many  new  programs.  The  advent  of  applied  degrees  at  colleges  and 
technical  institutes,  even  though  only  a  demonstration  project  at  this  time,  gives  rise  to  a  new  type  of 
credential  that  requires  a  full  year  (two  terms)  of  instructor  evaluated  work  experience  during  the 
program. 

Understanding  No.  14  -  CIS  Enrolment  Reporting  Manual 

Programs  that  involve  a  work  experience  component  continue  to  increase  in  number.  A  few  years  ago  a  department 
report  on  Programs  with  Work  Experience  found  there  were  approximately  30,000  students  in  such  programs, 
15,000  at  the  universities.  The  Access  Fund  has  stimulated  further  expansion  of  work  experience  opportunities  by 
funding  many  new  programs.  The  advent  of  applied  degrees  at  colleges  and  technical  institutes,  even  though  only  a 
demonstration  project  at  this  time,  gives  rise  to  a  new  type  of  credential  that  prescribes  a  full  year  (two  terms)  of 
instructor  evaluated  work  experience  during  the  four  year  program. 

There  are  three  aspects  to  using  CIS  for  reporting  programs  with  a  major  work  experience  component,  so  that  a 
proper  count  of  students  and  FLE  enrolment  and  even  Student  Contact  Hours  for  the  work  experience  terms  can  be 
calculated. 

i)  signaling  to  the  department  that  a  program's  requirements  include  work  experience,  and  describing  its  features; 
(this  applies  to  any  program  that  involves  any  amount  of  formal  work  experience) 

ii)  converting  work  experience  hours  to  credits  or  contact  hours,  and  reporting  the  loads  consistent  with  the  way 
loads  in  other  programs  are  reported  in  the  CIS  Look-Up  Table;  (again,  this  applies  as  well  to  any  program  with 
work  experience) 

iii)  reporting  for  each  student  the  credits  or  contact  hours  associated  with  a  full  term  of  work  experience  (this  is 
applicable  only  for  sessions  in  which  the  student  devotes  the  entire  session  to  work  experience). 

Item  (i)  is  reported  in  the  Special  Arrangements  and  Program  Delivery  sections  of  the  CIS  Program  System.  A  data 
element  called  Work  Experience  needs  to  be  filled  in.  There  the  institution  describes  some  of  the  features  of  the 


KPl  Reporting  Manual  -  November  1997 


Page  21 


Revisions  to  15/12/97 


[ 


overall  work  experience  for  the  program  as  a  whole,  including  the  length  in  days  and  total  credits  awarded  for  the 
work  experience. 

Item  (ii)  is  reported  in  the  Look-Up  Table.  Determining  what  is  the  appropriate  number  of  credits  or  contact  hours 
to  assign  to  the  work  hours  in  a  work  experience  activity  continues  to  be  a  nagging  problem  for  a  small  number  of 
programs.  Basically  it  is  institutions  who  are  responsible  for  determining  the  academic  load  represented  by  a  period 
of  work  experience,  consistent  with  how  the  load  for  the  remainder  of  the  program  is  determined.  Certain  provincial 
guidelines  are  necessary  to  assure  that  institutions  use  similar  practices.  The  basic  guideline  is  the  following: 

Institutions  need  to  convert  work  hours  to  credits,  contact  hours  or  other  units  used  to  represent  normal  program 
loads  in  the  Look-Up  Table.  How  many  credits  or  academic  contact  hours  should  be  assigned  to  the  work 
experience?  Base  the  conversion  on  the  courses  you  would  expect  a  student  to  take  if  the  student's  work  experience 
requirement  was  being  replaced  by  coursework.  In  practice,  when  converting  work  hours  to  academic  contact  hours, 
the  converted  contact  hours  per  day  should  not  exceed  the  hours  of  actual  student  contact  in  a  typical  full  day  of 
instruction  in  the  same  program. 

The  number  of  hours  (or  weeks)  spent  working  are  not  to  be  converted  one-for-one 
into  academic  hours  (or  weeks),  except  in  the  case  of  the  applied  degree  demonstration 
project  where  the  Minister  has  stipulated  that  one  year  will  consist  of  graded  work 
experience. 

Item  (iii)  is  reported  in  the  CIS  Student  System.  For  CIS  to  accommodate  students  who  are  spending  an  entire  term 
away  on  work  experience,  the  students  will  need  to  be  identified  in  the  Registration  Type  field  with  a  code  of  "X". 
This  new  code  has  been  added  to  indicate  that  the  student  is  away  on  work  experience  the  entire  session,  and  their 
FLE  is  due  to  the  work  experience.  If  a  student  manages  to  take  a  credit  course  in  addition  to  what  is  involved  in 
being  on  a  full-time  work  experience  assignment,  continue  to  record  the  student  record  using  the  "X". 

In  some  programs,  when  a  student  is  away  on  work  experience  for  the  entire  term  or  session,  the  student  does  not 
have  to  formally  register  at  the  institution.  In  CIS  such  a  student  would  earn  no  FLE  for  the  term  —  because  there 
was  no  load  taken  during  the  session  ~  unless  care  is  taken  to  report  these  students  in  CIS  as  if  they  were  registered 
for  part  of  the  program's  required  load.  Coop  engineering  programs  at  universities  have  traditionally  been  a  case 
where  no  credit  is  awarded  for  the  term  spent  away  at  work.  To  generate  an  FLE  value  within  CIS  these  engineering 
coop  students  will  have  to  be  reported  with  an  appropriate  academic  load  for  the  term  in  question.  See 
Understanding  No.  21  Reporting  Students  in  Graduate  Programs,  and  Other  No-Load  Students. 


Beginning  with  the  1995-96  academic  year,  all  required  work  experience,  even  when  the  student  is  away 
working  for  an  entire  session  or  year,  can  and  should  be  counted  toward  FLE  enrolment  in  official  enrolment 
reporting.  To  ensure  recognition  for  work  experience  where  it  has  not  been  counted  in  the  past,  it  will  be 
necessary  for  the  institution  to  register  and  report  all  students  who  spend  a  full  term  or  session  away  on  work 
experience.  NOTE:  For  short  work  experience  sessions  that  occur  within  courses  or  interspersed  between  other 
courses  in  a  session,  most  institutions  already  assign  an  equivalent  number  of  academic  credits  or  contact  hours 
and  the  FLE  is  included  in  students'  FLE  for  the  session.  CIS  cannot  handle  sufficient  details  on  these 
activities  to  separate  out  the  work  experience  related  FLE  enrolment.  Additional  data  elements  would  be 
needed  to  accomplish  this;  it  is  not  clear  at  this  time  whether  this  degree  of  detail  in  reporting  is  needed. 


The  basic  guideline  for  determining  the  amount  of  FLE  enrolment  to  claim  for  the  student  is  the  following: 

The  amount  of  FLE  enrolment  that  a  student  can  in  principle  generate  from  a  4-month  (half- 
year)  term  of  work  experience  ranges  from  a  low  of  0.20  FLE  to  as  much  as  0.5  FLE  enrolment 
(if  the  student  is  in  one  of  the  new  applied  degree  programs  at  colleges  or  technical  institutes). 
The  student  will  need  to  be  reported  as  taking  the  appropriate  credits  or  hours  to  generate  the 
proper  amount  of  FLE  enrolment. 

The  case  of  an  applied  degree  program  is  one  where  the  student  will  legitimately  earn  a  full  0.5 
FLE  for  one  term  of  work  experience,  while  earning  4.0  FLE  for  the  4-year  program.  That  is  the 
way  in  which  the  applied  degree  has  been  approved  to  operate.  A  traditional  engineering  coop 
program  with  three  to  five  4-month  terms  of  work  experience  is  a  case  where  a  student  might 
earn  only  0.2  to  0.33  FLE  for  each  4-month  session  spent  in  work  experience,  but  still 
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accumulate  a  total  of  5.0  FLE  upon  completing  the  5-year  program.  The  work  experience  adds 
one  year  to  the  requirements  of  the  traditional  4-year  program. 

In  both  the  applied  degree  and  the  engineering  coop  program  a  student  would  generate  1.0  FLE  for  the  required  work 
experience.  The  total  FLE  that  a  student  generates  by  completing  the  full  program  provides  a  ceiling  on  the  FLE 
from  the  work  experience.  A  two  year  program  typically  produces  2.0  FLE;  a  five  year  program  produces  5.0  FLE, 
for  each  student  who  completes  the  full  program. 

6.  Reporting  Unclassified  or  Non-Program  Students 

To  ensure  that  non-program  students  are  not  included  with  regular  full  and  part-time  students  in 
enrolment,  tracking  and  program  costing  indicators,  it  has  been  necessary  for  some  institutions  to  change 
the  way  they  are  reporting  non-program  registrations  in  CIS.  For  further  information  and  instructions  on 
this  issue,  refer  to  the  1989  Enrolment  Reporting  Manual,  November  1996  Update:  Understandings  No.2 
One  Record  per  Student  and  No.3  Reporting  Unclassified  Students,  available  at  www.gov.ab.ca/software. 

For  instructions  on  how  to  report  students  who  graduate  in  a  program  they  are  not  currently  enroled  in, 
refer  to  Understanding  No.  15  of  the  1989  Enrolment  Reporting  Manual,  November  1996  Update. 
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ACCESS  Indicators  (Enrolment  and  Instructional  Loads) 


Access  indicators  are  measures  of  student  participation  that  may  be  used  to  indicate  accessibility 
to  post-secondary  programs,  levels  of  service  provided  by  institutions  and  volumes  of 
instructional  activity: 

•  full-time  student  annual  headcount  -  credit  programs 

•  part-time  student  annual  headcount  -  credit  programs 

•  full-load  equivalent  enrolment  -  credit  programs 

•  student  contact  hours  -  credit  programs 

•  annual  student  headcount  -  non-credit  instruction 

•  course  and  program  registrations  -  non-credit  instruction 

•  student  contact  hours  -  non-credit  instruction 


Indicator(s)  Apply  to:                            Colleges  &  Technical 

Institutes 

Universities 

Private  Colleges 

Access  -  Credit  Programs 

Full-time  student  annual  headcount 

X 

X 

X 

Part-time  student  annual  headcount 

X 

X 

X 

Total  student  annual  headcount 

X 

X 

X 

Full  load  equivalent  enrolment 

X 

X 

X 

Student  contact  hours 

X 

Access  -  Non-Credit  Courses  and  Programs 

Annual  student  headcount 

X 

X 

X 

Course  and  program  registrations 

X 

X 

X 

Student  contact  hours 

X 

Level  of  Reporting:  Enrolment  in  credit  programs  by  program  as  follows: 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD  level. 
Vocational  Colleges  -  at  CIS  Standard  Name  level. 
Universities  -  at  CIS  Standard  Name  level,  by  program  length. 
Private  Colleges  -  at  CIS  ProgID  level. 

Enrolment  in  non-credit  courses  and  programs  at  the  institution  level 
only  (for  1996-97  programming) 

Scope:  Information  required  for  all  credit  program  types:  Preparatory  &  Basic 

Upgrading,  Skill  Training,  Trade  Certificate,  Apprenticeship,  Certificate, 
Diploma,  Other  Career  (Post-Certificate),  University  Transfer,  Applied 
Degree,  Bachelor  Degree,  Masters  Degree,  Ph.D.,  and  General  Studies. 
[See  Page  16]. 

Non-Credit  instructional  programming.  As  in  1995-96,  non-credit 
programming  data  for  1996-97  will  be  obtained  from  institutional 
records  and  entered  through  KPIRS.  Starting  in  1997-98,  a  new 
classification  system,  developed  in  consultation  with  institutions,  will  be 
used  to  collect  and  code  data  for  1997-98.  This  data  will  be  reported 
through  KPIRS  for  the  first  time  in  December  1998.  Highlights  of  the 
Non-Credit  Key  Performance  Indicators:  Final  Report  are  presented 
below.  For  more  detail  see  the  first  nine  (9)  pages  of  the  Final  Report  in 
Appendix  A. 
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Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Enrolment  in  Credit  Programs 

Full-time  student  annual  headcount 

CIS 

XL  Templates 

CIS 

Part-time  student  annual  headcount 

CIS 

XL  Templates 

Total  student  annual  headcount 

■L''T>TT>  C 

KrlKS 

XL  iemplates 

JsJrlKo 

Full  load  equivalent  enrolment 

CIS 

XL  Templates 

CIS 

Student  contact  hours  (CIS  proxy) 

CIS 

CIS 

Student  contact  hours  (Institution  actual) 

KPIRS 

KPIRS 

Number  of  program  completers^ 

CIS 

XL  Templates 

CIS 

Enrolment  in  Non-Credit  Programs 

Annual  student  headcount 

KPIRS 

XL  Templates 

KPIRS 

Course  registrations 

KPIRS 

XL  Templates 

KPIRS 

Student  contact  hours 

KPIRS 

XL  Templates 

KPIRS 

Specifications  and  Reporting  Protocols: 
Credit  Programs 

Credit  programs  are  those  recognized  and  included  in  the  AECD  Common  Information  System  (CIS) 
program  file  as  acceptable  for  official  enrolment  reporting.  The  1989  AECD  Enrolment  Reporting 
Manual  includes  a  detailed  description  of  terms  and  conditions  to  differentiate  credit  from  non-credit 
programs,  courses  and  enrolments  and  should  be  used  as  a  basis  for  credit  and  non-credit  categorization. 

The  credit  enrolment  data  required  for  Access  indicators  is  available  for  each  institution  through  CIS. 
This  data  will  be  extracted  from  CIS  and  transferred  to  the  KPI  Reporting  System  (KPIRS)  for  use  where 
credit  enrolment  data  are  required.  It  is  available  through  CIS  at  an  elemental  program  level  (CIS 
"ProgID"),  or  by  aggregation  to  the  Standard  Name  and  higher  levels. 

Note:  CIS  is  not  yet  fully  operational  for  the  universities  or  for  Canadian  University  College.  For  the 
January  1998  data  collection  round,  credit  enrolment  data  will  need  to  be  generated  from  institutional 
records  and  reported  via  Excel  spreadsheet  templates. 

Full-time  student  annual  headcount  -  For  KPI  purposes,  the  annual  unduplicated  headcount  of  full-time 
students  is  the  number  of  individual  students  who  have  been  counted  as  full-time  during  at  least  one 
session  of  the  academic  year.  A  full-time  student  in  CIS  is  an  active  student  in  a  Summer,  Fall, 
Winter  or  Spring  session  who  is  registered  in  that  session  for  at  least  30%  of  the  full  year  load  for  the 
program. 

Part-time  student  annual  headcount  -  For  KPI  purposes,  the  annual  headcount  of  part-time  students  is 
an  unduplicated  headcount  of  students  enroled  in  a  reporting  year  who  have  not  been  counted  as  full- 
time  during  at  least  one  session  of  the  year.  Effectively,  part-time  enrolment  will  be  equal  to  the  total 
headcount  of  individuals  served  during  the  year  less  the  full-time  headcount. 

Total  student  annual  headcount  -  An  unduplicated  count  of  the  total  number  of  students  served  in  each 
program  during  a  reporting  period. 


^  The  Number  of  Program  Completers  is  not  an  Access  Indicator  element.  It  is  required  for  Graduating  Student 
Satisfaction,  Graduate  Employment  and  Academic  Outcomes,  and  Cost  per  Graduate  (Program  Completer) 
indicator  calculations.  The  nature  of  CIS  and  KPIRS  are  such  that  this  data  element  is  best  captured  with  the 
Access  indicator  data. 
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Unduplicated  headcounts  -faculty  and/or  institutional  aggregations  -  Over  the  course  of  a  reporting 
year,  a  substantive  number  of  students  may  enroll  in  more  than  one  program.  Accordingly,  totals  for 
aggregations  of  programs  arrived  at  by  the  simple  addition  of  program  totals  will  not  agree  with 
unduphcated  headcounts  produced  at  the  higher  levels  of  aggregation.  CIS  will  be  used  to  produce 
unduplicated  total  headcounts  at  the  institutional  and  other  levels  and  these  will  be  used  in  place  of 
totals  produced  by  simply  summing  the  program  headcounts. 

Full-load  equivalent  (FLE)  enrolment  -  A  unit  measure  of  enrolment  in  which  one  FLE  represents  one 
year  of  study  taking  a  full  load.  A  full  load  is  the  number  of  credits  or  hours  required  to  complete  the 
requirements  for  a  full  year  of  study,  typically  during  the  Fall  and  Winter  sessions  of  the  academic 
calendar  (i.e.,  September  through  April).  (For  further  detail,  see  the  1989  AECD  Enrolment 
Reporting  Manual.)  CIS  generates  this  data  element  for  each  student's  program  and  these  are 
aggregated  to  the  ProgID  level  for  use  in  KPIRS. 

Student  contact  hours  -  SCH  -  ( Credit  Programs)  -  The  sum  of  contact  hours  per  student  per  week 
times  the  number  of  weeks  in  a  session  for  each  student  enroled  in  a  reporting  period.  Contact  hours 
are  the  actual  periods  of  time  (measured  in  hours  and  portions  thereof)  during  which  classes  or 
sections  of  students  are  engaged  in  scheduled  periods  of  lecture,  laboratory  and/or  tutorial  activities, 
and  an  instructor  or  instructors  are  present. 

CIS  permits  program  load  information  to  be  expressed  in  contact  hours,  credits  or  equivalent  units. 
Colleges  and  Technical  Institutes  may  use  credits  or  contact  hours  as  per  CIS  definitions  and  guideline 
Instructional  load  information  can  be  derived  from  program  load  data  but  is  only  a  proxy  for  the  actual 
hours  that  students  are  scheduled  in  classes,  labs,  seminars  and  work  experience.  Where  the  proxy 
calculations  is  not  adequate  to  represent  students'  actual  hours  of  scheduled  learning  activities. 
Colleges  and  Technical  Institutes  may  do  their  own  calculations  and  enter  the  results  directly  in  the 
Student  Contact  Hours  section  of  the  Access  Information  Set. 

CIS  has  been  changed  for  1997-98  reporting  to  enable  institutions  to  report  the  actual  contact  hours 
needed  for  KPI  purposes.  Meanwhile,  a  proxy  for  actual  SCH  based  on  credits  or  hours  and  weeks  of 
instruction  can  still  be  calculated  from  the  CIS  program  load  data.  The  proxy  will  be  best  suited  to  3 
credit  courses  in  programs  that  do  not  involve  labs,  etc. 

Contact  hour  equivalents  for  instructional  modes  and/or  settings  where  SCHs  would  not  be 
determined  on  a  systematic  basis  need  to  be  dealt  with  as  exceptions.  The  following  guidelines, 
designed  to  take  into  account  the  different  intensities  of  involvement  of  instructional  staff  (faculty- 
student  contact),  should  be  used  for  such  modes  and  settings: 

Practicum  -  The  term  "practicum"  applies  to  a  broad  range  of  learning  settings  and  experiences, 
ranging  from  a  volunteer  observation  experience  to  direct  involvement  in  the  workplace  (e.g. 
community  agency,  radio  station,  theatre)  wherein  the  workplace  serves  as  the  classroom  and  students 
are  under  the  direct  supervision  of  staff  of  the  organization  or  agency,  and/or  instructors  in  the 
program.  Guideline  for  SCH  equivalence:  1  hour  of  practicum  =  0.25  contact  hours. 

[  Note:  In  some  institutions  the  term  practicum  is  used  to  apply  to  a  learning  experience  supervised  by 
college  staff  in  a  college-operated  facility,  e.g.,  cooking  students  in  a  college-run  cafeteria,  ECD 
students  in  a  college-operated  daycare,  etc.  In  such  cases,  a  higher  SCH  equivalency  may  be 
appropriate  with  a  guideline  of  1  hour  of  practicum  =  0.33  contact  hours  suggested  as  a  guideline.] 

Clinical  -  The  term  "clinical"  is  most  often  used  to  identify  learning  experiences  within  Health 
Sciences  programs,  or  other  similar  learning  experiences  where  students  are  directly  and  constantly 
supervised  due  to  the  nature  of  the  activities  and  the  risks  and/or  liabilities  involved  for  the  host 
organization  or  agency,  the  college,  students  and  clients.  The  clinical  setting  usually  involves  clearly 
specified  learning  objectives,  and  a  very  clear  role  for  supervisors,  instructors  and/or  preceptors  who 
work  very  closely  with  students  in  this  setting.  Guideline  for  SCH  equivalence:  1  hour  of  clinical 
experience  =  0.50  contact  hours. 
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Field  work /field  placement  -  Field  work  or  field  placement  learning  experiences  may  be 
components  of  regularly  scheduled  classroom  experience  or  extensions  of  the  classroom, 
differentiated  from  practicum  or  chnical  experiences  by  the  relatively  less  intensive  involvement  of 
college  staff.  Instructors  may  visit  the  field  setting  from  time  to  time,  but  their  supervision  is  indirect 
and  their  role  in  the  field  is  facilitative  and  advisory.  Guideline  for  SCH  equivalence:  1  hour  of  field 
work  =  0.33  contact  hours.  See  Page  21  for  more  detail  regarding  the  use  of  CIS  in  reporting 
programs  with  a  work  experience  component. 

Number  of  Program  Completers  (Graduates)  -  The  total  number  of  students  who  have  been  determined 
by  the  institution  to  have  completed  all  graduation  requirements  for  a  program,  during  the  reporting 
year  for  which  data  is  being  reported  and  to  whom  the  institution  would  therefore  confer  a  parchment 
where  a  parchment  is  offered.  Data  for  the  number  of  program  completers  is  reported  through  CIS  by 
Colleges  and  Technical  Institutes  and  Private  Colleges.  Universities'  data  will  be  reported  through 
XL  templates  until  available  through  CIS.  The  term  "graduate"  has  the  same  meaning  as  "program 
completer". 

Non- Credit  Programming 

KPI  reporting  for  non-credit  programming  has  been  under  review  over  the  past  year.  A  report  prepared 
in  consultation  with  institutions  recommends  a  new  approach  to  reporting  on  this  programming.  A  new 
reporting  structure  has  been  accepted  for  implementation  during  1997-98  as  the  basis  for  reporting  in 
December  1998. 

Highlights  of  the  Non-Credit  KPI:  Final  Report  -  for  1997-98  coding  for  December  1998  reporting: 

Level  of  Reporting:  Registrations  and  student  contact  hours  in  courses  and  programs  -  at  a 

minimum  at  the  subject  area  level  (see  Page  13). 
Non-credit  students  annual  headcount  in  courses  and  programs  -  at  the 
institutional  level. 

Scope:  Information  required  for  all  non-credit  programming  categories: 

Courses,  Flexible  Programs,  and  Programs 

New  Programming  Categories:    The  new  reporting  structure  contains  three  (3)  mutually  exclusive 

programming  categories:  courses,  flexible  programs,  and  programs.  In 
addition,  there  are  two  (2)  sub-categories  -  one  for  customized  training 
and  one  for  programming  for  children.  See  Appendix  A,  pages  4-8  of 
the  Final  Report. 

A  new  data  element  -  flexible  program  completers  -  has  been  added  to 
capture  the  amount  of  activity  occurring  in  the  Flexible  Programs 
category.  See  Appendix  A,  pages  5-8  of  the  Final  Report. 

Reporting  for  1996-97  (January  1998)  should  be  at  the  institutional  level  as  in  1995-96  and  on  the  basis 
of  the  following  specifications: 

Non-credit  students  annual  headcount  -  The  total  number  of  students  (unduplicated  headcount) 

participating  in  programs  or  courses  not  recognized  for  credit  in  CIS  reporting,  for  all  sessions  in  the 
reporting  year.  Institutions  currently  unable  to  calculate  unduplicated  headcount  should  leave  this 
field  blank  in  KPIRS.  As  with  credit  reporting,  learning  activities  that  have  been  reported  by  another 
institution  through  a  brokering  arrangement  should  not  be  included  in  the  headcount.  See  Page  18  on 
Brokered  Programs. 

Non-credit  registrations  -  The  total  number  of  registrations  in  courses  or  programs  not  recognized  for 
credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year.  A  student  enroled  in  a  course  or  program 
which  is  subsequently  cancelled  should  not  be  counted.  A  student  withdrawing  before  a  course  or 
program's  withdrawal  date  should  not  be  included;  a  student  withdrawing  after  the  withdrawal  date 
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should  be  included.  Since  students  may  be  registered  in  more  than  one  course  or  program  over  the 
course  of  a  year  at  a  given  institution,  registration  counts  are  generally  higher  than  unduplicated 
headcounts. 

Student  contact  hours  (non-credit  programming)  -  An  aggregation  of  the  product  of  the  number  of 
registrations,  the  number  of  weeks  and  the  number  of  contact  hours  per  week  in  each  course  or 
program  not  recognized  for  credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year.  In  courses  or 
programs  that  are  not  delivered  in  a  traditional  format  (that  is,  not  in  a  classroom  with  an  instructor 
present),  the  number  of  contact  hours  that  would  have  been  accumulated  had  the  course  been  offered 
in  the  traditional  manner  should  be  used  as  a  proxy  for  actual  student  contact  hours. 
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PROGRAM  COMPLETION 

IHMIiHlilillnlill'''lffillliiiililliH  II     >  ^  . 


Program  Completion  indicators  are  intended  to  show  whether  students  who  enter  as  full-time 
students  complete  their  programs  of  study  over  a  reasonable  periods  of  time. 

For  Colleges  and  Technical  Institutes,  the  "program  completion  rate"  is  the  proportion  of  an 
entry  cohort,  expressed  as  a  percentage,  who  complete  a  one  year  or  shorter  program  within  two 
years,  or  a  two  year  or  longer  program  within  three  years,  following  the  earliest  year  in  which  a 
student  with  a  full  year  program  load  would  normally  be  expected  to  complete  the  program. 
Completion  rates  are  calculated  to  include  those  who  complete  the  program  entered  and  those 
who  transfer  to  and  complete  other  programs. 

For  Universities  and  Private  Colleges,  the  "program  completion  rate"  is  the  proportion  of 
students,  adjusted  for  freshmen  not  returning  in  the  year  following  entry,  who  proceed  to 
successfully  complete  an  undergraduate  degree  or  diploma  program  within  a  period  ending  three 
years  after  the  earliest  year  in  which  a  student  with  a  full  annual  program  load  would  normally 
be  expected  to  complete  the  program.  Completion  rates  are  calculated  to  include  those  who 
complete  the  program  entered  and  those  who  transfer  to  and  complete  other  programs. 

For  Preparatory  &  Basic  Upgrading  programming  the  completion  indicator  is  constructed  as  a 
course  completion  rate  to  show  whether  PBU  students  complete  their  courses  of  study  within 
the  term  over  which  the  courses  of  study  are  offered.  The  PBU  completion  rate  is  the  total 
number  of  course  completions  expressed  as  a  percentage  of  the  total  course  registrations  for  any 
program  area  in  any  reporting  year. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Program  completion  indicator 

X 

Except  AU 

X 

Course  completion  rate 

PBU  programming 

Transfers  to  other  institutions 

Optional 

Optional 

Non-completers  still  active 

X 

Optional 

Optional 

Graduate  to  FLE  enrolment  ratio 

AU  only 

#  of  course  completions 

AU  only 

Level  of  Reporting:  Program  completion  information  is  required  by  program: 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD  by  XrefID  level. 
Vocational  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 
Universities  -  at  CIS  Standard  Name  level,  by  program  length. 
Private  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 

Course  completion  data  is  required  for  Preparatory  &  Basic  Upgrading 
(PBU)  program  areas  at  the  CIS  Standard  Name  level.  [See  Page  15]. 

Scope:  Information  required  for  the  following  parchment  program  types:  Skill 

Training,  Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post- 
Certificate),  Applied  Degree,  and  Bachelor  Degree.  [See  Page  16]. 
Graduate  programs  are  not  included. 

Course  completion  information  is  required  for  Preparatory  &  Basic 
Upgrading. 
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Data  Elements  &  Reporting  Systems: 


Faculty 

Program 

Entry  year 

Program  length 

Entry  cohort 

Earliest  completion  year 

#  of  completers  entry  program 

#  of  completers  other  programs 
Program  completion  rate 
Completion  cohort  freshmen  entry  stream 
Completion  cohort  other  entry  stream 

#  of  completers  entry  program  freshmen 

#  of  completers  entry  program  other 

#  of  completers  same  faculty  freshman 

#  of  completers  same  faculty  other 

#  of  completers  other  faculties  freshmen 

#  of  completers  other  faculties  other 

#  of  completers  other  programs  freshmen 

#  of  completers  other  programs  other 
Program  completion  rate  freshmen 
Program  completion  rate  other 
Transfers  to  other  institutions  freshmen 
Transfers  to  other  institutions  other 
Non-completers  still  active  freshmen 
Non-completers  still  active  other 

Athabasca  University 

#  of  graduates  (completers) 
Graduate  to  FLE  enrolment  ratio 

#  of  course  completions 

Preparatory  &  Basic  Upgrading 

Program  area  (CIS  Standard  Name) 
Total  course  registrations 
Total  course  completions 
Course  completion  rate 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  tfirough  (or  calculated  by) 

CIS 
CIS 
CIS 
CIS 
CIS 
CIS 
CIS 
CIS 


CIS' 
KPIRS 
KPIRS 
KPIRS 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 

XL  Templates  ' 
XL  Templates  ^ 
XL  Templates  ^ 


CIS 
CIS 
CIS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 


1      Athabasca  University  only. 


Specifications  &  Reporting  Protocols: 

Entry  cohort  /  entry  year  -  A  group  of  students  who  have  commenced  study  as  full-time  students 

(registered  in  the  entry  session  for  at  least  30%  of  the  normal  annual  load  for  the  program)  in  the  same 
program  at  the  same  time  or  during  the  same  time  period.  For  KPI  reporting  purposes  the  time  period 
will  be  a  year  ending  June  30*  (an  ''Entry  Year").  For  Universities  and  Private  Colleges,  the  entry 
cohort  is  adjusted  for  students  who  transfer  between  programs  by  the  start  of  the  year  following  the 
entry  year. 
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For  Universities  &  Private  Colleges 

The  methodology  for  this  indicator  involves  features  that  were  strongly  endorsed  by  the 
universities  when  the  indicators  were  being  developed.  But  these  features  introduced  a  number 
of  complications/uncertainties  that  have  made  it  difficult  for  institutions  or  the  department  to 
come  up  with  consistent  specifications  and  to  write  a  program  to  calculate  a  program  level 
completion  rate.  The  various  approaches  taken  to  date  have  resulted  in  data  that  works  only  for 
an  institution  level  rate. 

The  two  features  are  (1)  the  entry  cohort  for  each  program  has  to  be  adjusted  to  allow  for 
students  who  transfer  out  or  in  at  some  point  before  the  end  of  the  year  following  the  entry 
year;  and  (2)  freshman  who  are  no  longer  attending  the  institution  during  the  entry  year+1  are 
removed  completely  from  any  entry  year  cohort  even  if  they  return  and  complete  the  program 
within  the  period  for  which  completions  are  being  counted. 

A  methodology  that  will  produce  comparable  and  reliable  completion  rates  at  a  program  level  is 
required.  The  department  is  working  with  the  universities  to  come  up  with  such  a  methodology, 
preferably  one  closer  to  the  approach  used  in  other  sectors. 


Program  length  (y)  -  The  intended  number  of  academic  years  required  for  a  continuously  enroled  full- 
time  student  to  complete  all  requirements  for  a  certificate,  diploma  or  degree.  Normally  1  year  for  a 
certificate  program,  2  years  for  a  diploma  program,  and  4  years  for  a  bachelor  degree. 

Entry  year  -  see  Entry  cohort  /  entry  year. 

Earliest  completion  year  -  The  earliest  academic  year  during  which  a  student  taking  full  year  course 
loads  may  be  expected  to  complete  the  graduation  requirements  for  a  certificate,  diploma  or  degree 
program.  For  a  two  year  diploma  program,  the  earliest  completion  date  for  a  substantial  number  of 
students  will  be  April  of  the  year  following  the  entry  year,  and  the  earliest  completion  year  will  be  the 
year  ending  June  30*  of  that  year.  For  a  one  year  certificate  program,  the  earliest  completion  year  will 
be  the  same  year  as  the  entry  year.  For  a  four  year  degree  program,  the  earliest  completion  year  will 
be  the  third  year  following  the  entry  year. 

Completion  cohort  freshmen  entry  stream  /  other  entry  stream  -  (Universities  and  Private  Colleges)  - 
Each  entry  cohort  is  subdivided  into  a  "freshmen  entry  stream"  (students  who  are  new  to  the 
institution  at  entry  and  who  are  not  granted  transfer  or  advanced  credit  at  entry,  or  whose  last 
institution  attended  was  a  high  school),  and  an  "other  entry  stream"  (all  other  entrants).  For  each 
program,  the  students  in  the  freshman  entry  stream  are  adjusted  for  those  not  returning  to  the 
institution  in  the  subsequent  year  and  for  inter-program  transfers  to  constitute  the  "completion  cohort  - 
freshman  entry  stream".  The  students  in  the  other  entry  stream  are  adjusted  for  transfers  to  constitute 
the  "completion  cohort  -  other  entry  stream". 

Completer  -  Any  student  who  has  been  determined  by  the  institution  to  have  completed  all  graduation 
requirements  and  to  whom  the  institution  would  therefore  confer  a  parchment  where  a  parchment  is 
offered. 

#  of  completers  -  (Colleges  &  Technical  Institutes)  -  The  number  of  students  who  complete  graduation 

requirements  for  their  entry  program  (#  of  completers  entry  program)  or  some  other  program  (#  of 
completers  other  programs)  within  a  period  ending  two  years  after  the  earliest  completion  year  for  a 
one  year  certificate  program  or  three  years  after  the  earliest  completion  year  for  a  two  year  diploma  or 
an  applied  degree  program. 

#  of  completers  -  (Universities  and  Private  Colleges)  -  The  number  of  students  from  the  completion 

cohort  who  complete  graduation  requirements  for  the  degree,  certificate  or  diploma  within  a  period 
ending  three  years  after  the  earliest  completion  year  for  the  program.  For  a  four  year  program  with 
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earliest  completion  in  1990-91,  completers  would  be  counted  to  June  30,  1993-94.  For  a  two  year 
diploma  (entry  year  1987-88),  the  earliest  completion  year  would  be  1988-89,  with  completers 
counted  through  1991-92.  Completers  are  grouped  and  counted  for  each  entry  stream  (freshmen, 
other)  within  each  of  the  following  categories:  entry  program,  other  program  in  same  faculty, 
program  in  different  faculty. 

Program  completion  rate  -  (Colleges  &  Technical  Institutes)  -  The  total  number  of  completers  for  a 
program,  expressed  as  a  percentage  of  the  entry  cohort.  The  entry  (or  completion)  cohorts  may  be 
aggregated  up  to  the  institution  level,  along  with  the  total  number  of  completers.  Once  all  program- 
level  entry  or  completion  cohorts  have  been  tracked  for  the  appropriate  period,  an  institution-level 
completion  rate  can  be  calculated. 

Program  completion  rate  -  (Universities  and  Private  Colleges)  -  The  number  of  students  from  a 

completion  cohort  (freshman  entry  stream,  other  entry  stream)  who  complete  graduation  requirements 
(including  application  to  graduate)  for  an  undergraduate  degree,  diploma  or  certificate  during  the 
completion  period  for  their  cohort  (i.e.,  before  the  end  of  the  third  year  following  the  earliest 
completion  year)  either  in  their  entry  program  or  in  some  other  program,  as  a  percentage  of  the  total 
number  in  the  completion  cohort.  Once  all  program  level  entry  or  completion  cohorts  have  been 
tracked  for  the  appropriate  period,  an  institution  level  completion  rate  can  be  calculated. 

Transfers  to  other  institutions  freshmen  /  other  -  Significant  number  of  students  may  transfer  from  one 
institution  to  another  prior  to  completing  a  program.  "Sending"  institutions  may  wish  to  identify,  at 
the  program  and/or  institutional  level,  the  numbers  of  transfers  to  another  institution.  This  can  be 
done  by  searching  the  Alberta  Council  on  Admission  and  Transfer  duplicate  application  detection 
project  (DAD)  database  for  non-completers  who  are  no  longer  active  at  the  institution  to  identify  the 
numbers  attending  another  institution  in  subsequent  years.  This  is  an  optional  data  element. 

Non-completers  still  active  -  Some  institutions  may  wish  to  report,  by  program  and/or  at  the 
institutional  level,  the  number  of  students  who  are  still  actively  pursuing  a  degree,  diploma  or 
certificate  at  the  end  of  the  period  over  which  completers  have  been  accumulated.  This  is  an  optional 
data  element. 

Graduate  to  FLE  enrolment  ratio  &  #  of  course  completions-  Athabasca  University  programs  and 
students  are  such  that  the  indicators,  formats,  methods  and  procedures  are  not  appropriate.  AU  will 
report  a  "graduate  to  FLE  enrolment  ratio"  and  the  "number  of  course  completions"  at  a  program 
level.  The  term  "graduate"  has  the  same  meaning  as  "program  completer".  A  "course  completer"  is  a 
student  who  has  achieved  the  course  objectives  and  received  credits  where  offered. 

Program  area  -  The  broad  program  grouping  at  which  course  registrations  are  to  be  summarized  and 
reported  for  Preparatory  &  Basic  Upgrading  programs.  The  program  area  will  correspond  to  the  CIS 
Standard  Name,  such  as  Adult  Literacy,  ABE,  ESL.  Some  institutions  may  deliver  these  as  non-credit 
offerings. 

Total  course  registrations  -  The  total  number  of  registrations  in  all  (credit  or  non-credit)  course 
offerings  in  the  program  area  in  the  reporting  year. 

Total  course  completions  -  The  number  of  successful  course  completions  resulting  from  the  total  course 
registrations  recorded  for  the  "program  area".  A  student  has  successfully  completed  a  course  when 
he/she  has  achieved  the  course  objectives. 

Course  completion  rate  -  The  ratio  of  total  completions  to  total  course  registrations  in  the  "program 
area". 
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Generating  College  &  Technical  Institutes'  Program  Completion  Elements  from  CIS  Data  -  The 
following  steps  will  be  used  by  AECD  to  generate  program  completion  information  elements  from  CIS 
data: 

1 .  Identify  programs  for  which  program  completion  rates  are  to  be  reported  and  classify  by  KPI 
Program  Type. 

2.  Classify  programs  by  program  length. 

3.  For  a  given  entry  year,  establish  the  earliest  completion  year  for  each  program. 

4.  For  each  program  count  the  number  of  full-time  students  new  to  the  program  in  the  entry  year. 
Where  students  have  switched  or  transferred  between  programs  during  the  entry  year,  count  the 
student  in  the  last  program  of  entry.  This  is  the  "Entry  Cohort". 

5.  For  each  program,  count  the  number  of  students  who  complete  graduation  requirements  for  the 
program  by  June  30*  of  the  earliest  completion  year  (column  1  in  the  following  table)  and,  count  the 
number  who  completed  requirements  for  any  other  diploma  or  certificate  during  the  same  period 
(column  6). 


Number  of  Completers  -  Entry  Program 

Number  of  Completers  -  Other  Programs 

by  June  30 

by  June  30 

by  June  30 

by  June  30 

Total 

by  June  30 

by  June  30 

by  June  30 

by  June  30 

Total 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(V 

(8) 

(9) 

(10) 

Repeat  for  two  more  years  for  one  year  programs  and  three  more  years  for  two  year  and  longer 
programs,  and  accumulate  the  results. 

7.  Add  numbers  of  completers  in  entry  programs  to  numbers  of  completers  in  other  programs  and  divide 
the  total  by  the  number  of  students  in  the  Entry  Cohort  to  produce  the  completion  rate  for  the 
program. 

8.  Repeat  for  each  program. 

Notes  re:  Colleges  &  Technical  Institutes 

■  Students  who  entered  a  cohort  as  full-time  students  and  whose  status  changes  to  part-time  will  remain  in  the 
cohort. 

■  Internal  transfer  students  (transferring  within  the  institution  to  another  "new"  program  in  a  subsequent  year) 
will  remain  in  the  "entry"  cohort  of  the  earlier  year.  Completion  rates  will  be  reported  for  those  who 
completed  their  entry  program  and  for  those  who  completed  another  program.  Students  who  transfer  before 
June  30  of  their  year  of  entry  will  be  included  in  the  program  of  record  as  at  June  30  of  that  year. 

■  Institutions  with  significant  numbers  of  students  transferring  internally  or  externally  from  programs  other  than 
those  specified  for  University  Transfer  Program  Leaver  reporting  may  wish  to  provide  supplementary 
information  and/or  reference  notes. 


Generating  Universities  and  Private  Colleges  Program  Completion  Elements  from  CIS  Data  -  The 

following  steps  will  generate  program  completion  information  elements  from  CIS  data  when  available, 
and  should  be  applicable  to  local  databases  in  the  interim: 

1 .  Identify  programs  at  the  CIS  Standard  Name  level  for  which  program  completion  rates  are  to  be 
reported  and  classify  by  faculty. 

2.  Classify  programs  by  program  length.  Where  a  Standard  Name  classification  includes  separate 
programs  (at  the  CIS  ProgID  level)  of  different  lengths,  group  the  programs  based  on  length  and 
create  a  separate  cohort  for  each  group. 
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3.  For  a  given  entry  year  "x",  establish  the  earliest  completion  year  "x+y-l"  for  each  program.  For 
December  1996  reporting  the  entry  year  1988-89  was  agreed  upon.  This  is  to  be  advanced  by  one 
year  in  each  subsequent  reporting  year. 

4.  Establish  an  entry  cohort  for  each  program  or  sub-program.  Identify  the  number  of  full-time 
undergraduate  students  new  to  the  program  in  the  entry  year  or  appearing  for  the  first  time  as  full- 
time  students.  Exclude  unclassified,  visiting,  audit-only,  probationary  and  special  students. 

5.  Where  students  have  switched  or  transferred  between  programs  during  the  entry  year  or  between  the 
entry  year  and  their  second  year,  remove  them  from  their  original  entry  cohort  and  add  them  to  the 
entry  cohort  (same  stream)  for  their  "new"  program  (as  if  they  had  entered  that  program  at  the 
outset).  Exclude  any  internal  transfers  who  were  in  the  entry  year  of  a  cohort  in  a  prior  year  since 
they  will  have  been  "reclassified"  in  this  way. 

6.  Remove  any  freshman  students  who  are  not  continuing  in  the  institution  in  the  Fall  after  the  entry 
year. 

7.  Subdivide  the  entry  cohort  into  a  freshmen  entry  stream  and  an  "other  (than  freshmen)"  entry  stream. 
These  are  the  "Completion  Cohorts". 

8.  Check  to  ensure  that  no  student  is  in  two  entry  cohorts  of  the  same  year. 

9.  For  each  cohort,  identify  the  students  who  completed  graduation  requirements  for  any  undergraduate 
degree,  diploma  or  certificate  during  the  period  ending  three  years  after  the  earliest  completion  year. 
Group  and  count  the  completers  in  three  categories  -  completing  the  same  program,  completing  a 
different  program  in  the  same  faculty,  or  finishing  any  other  program. 

10.  Aggregate  the  results  from  step  9. 

1 1 .  Divide  the  total  number  of  completers  by  the  number  of  smdents  in  the  Completion  Cohort  to 
produce  the  completion  rate  for  each  program  or  program  sub-group. 

Note  re:  Cooperative  Programs  -  The  cooperative  program  model  and  similar  delivery  arrangements  can 
introduce  periods  of  up  to  a  year  (or  more)  during  which  normal  academic  study  is  interrupted,  with  the 
effect  that  earliest  completion  year  for  students  in  the  "co-op"  offering  of  a  program  will  be  later  than  for 
students  in  the  regular  program.  In  such  cases,  the  offering  should  be  defined  as  a  separate  program  with 
the  program  length  and  earliest  completion  year  based  on  the  particular  structure  and  characteristics  of 
the  program. 

Generating  course  completion  rates  for  Preparatory  &  Basic  Upgrading  programs:  -  The  following 
table  will  assist  institutions  in  generating  the  data  to  be  reported  through  KPIRS  for  the  course 
completion  rate  by  subject  area.  It  illustrates  how  course  registrations,  course  completions  and  course 
completion  rates  can  be  aggregated  by  Standard  Name  and  the  results  entered  through  KPIRS. 
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Courses  grouped  by 
Standard  Name 

Term 

Course 
Registtadons 

Couise 
Corr^MoTS 

Course  Conf^tkn  Rate 

Standard  Name  1,  e.g.  Adult  Literacy 

Course  1 
Course  2 
Course ...  etc. 
Total  SNl,e.g.  AL 

to  KPIRS  screen 

to  KPIRS  screen 

calculated  by  KPIRS 

Standard  Name  2,  e.g.  Adult  Basic  Education 

Course  1 
Course  2 
Course  ...  etc. 

Total  SN2,  e.g.  ABE                                 to  KPIRS  screen 

to  KPIRS  screen 

calculated  by  KPIRS 

Notes  re:  Course  Completion 

■  Completion  rates  will  be  generated  at  the  Standard  Name  level  as  defined  in  CIS  for  each  institution. 

■  Students  who  have  remained  in  the  course  past  the  institutions'  own  deadline  for  withdrawal  without  academic 
penalty  are  considered  active  in  the  course  and  their  registration  is  to  be  counted. 

■  The  sum  of  all  active  course  registrations  should  be  entered  in  Total  Course  Registrations. 

■  The  sum  of  all  active  course  registrations  resulting  in  a  successful  completion  should  be  entered  in  Total 
Course  Completions.  A  student  has  successfully  completed  a  course  when  he/she  has  achieved  the  course 
objectives. 
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FRESHMAN  STUDENT  PERSISTENCE 

Measures  of  persistence  for  students  new  to  the  first  year  of  undergraduate  programs  at  a 
university  or  a  private  college.  Attrition  between  September  30  and  December  1  is  determined 
and  a  first  session  retention  rate  calculated.  The  number  of  students  returning  in  the  following 
year  is  determined  and  first-to-second  year  retention  rate  is  calculated.  First  year  leavers  are 
categorized  as  those  required  to  withdraw,  those  who  transferred  to  other  Alberta  post-secondary 
institutions,  and  others  not  returning. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Retention  Rate  -  Sept.  to  December 

except  AU 

X 

Retention  Rate  -  Dec.  to  December 

except  AU 

X 

Freshmen  not  returning: 

%  required  to  withdraw 

except  AU 

X 

%  transferring  to  other  Alberta  PSIs 

except  AU 

X 

%  other 

except  AU 

X 

Level  of  Reporting:  Credit  programs  at  CIS  Standard  Name  level,  by  program  length.  [See 

Page  15] 

Scope:  Information  required  for  programs  in  which  cohorts  of  freshmen 

commence  study  toward  an  undergraduate  degree,  diploma  or  certificate. 


Data  Elements  &  Reporting  Systems: 


Entry  program 

#  of  full-time  freshman  students: 

Registered  at  September  30  (year  x) 
Enroled  full-time  or  part-time  December  1 
(year  x) 

Attrition  September  to  December 
Retention  rate  September  to  December 

#  enroled  full-time  December  1  (Year  x) 

#  enroled  December  1  (Year  x+1) 

#  enroled  December  1  (Year  x-hI)  as  %  of 

freshmen  December  1  (Year  x) 

#  of  full-time  freshman  students  December  1 

(Year  x)  who  did  not  return  for  the 
following  Fall  session: 

#  required  to  withdraw 

%  of  total  not  returning 

#  of  transfers  to  AB  PSIs 

%  of  total  not  returning 

#  of  others  not  returning 

%  of  total  not  returning 
Total  not  returning 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

XL  Templates 

XL  Templates 

XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 

XL  Templates 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


KPIRS 

KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 

KPIRS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
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Note  re:  CIS  as  a  Data  Source:  With  one  exception,  the  data  elements  required  for  Freshman 
Persistence  calculations  are  available  through  the  AECD  Common  Information  System  (CIS).  The 
exception  is  the  "#  of  full-time  students  registered  at  September  30  (year  x)".  For  CIS  to  be  used  to 
generate  Freshman  Persistence  Indicator  data,  institutions  will  need  to  supply  either  a  listing  of  students 
who  are  active  full-time  students  as  of  September  30th,  or  a  listing  of  the  full-time  students  who  were 
registered  on  September  30'^,  but  not  enroled  as  active  students  on  December  1^^  Otherwise,  institutions 
will  need  to  generate  freshman  persistence  indicator  data  from  institutional  records. 


Specifications  &  Protocols: 

Entry  program  -  The  program,  classified  by  faculty  for  universities,  in  which  a  cohort  of  freshmen 
commence  study  toward  an  undergraduate  degree,  diploma  or  certificate. 

#  of  full-time  freshmen  students  -  Full-time  students  who  are  new  to  an  institution  at  entry  and  who  are 

not  granted  transfer  or  advanced  credit  on  entry,  or  whose  last  institution  attended  was  a  high  school. 
Using  CIS  definitions  a  full-time  student  is  a  student  carrying  the  equivalent  of  30%  or  more  of  the 
actual  full-year  load  for  the  program. 

#  enroled  full-time  or  part-time  December  1  (year  x)  -  The  number  of  freshmen  students  who  were 

enroled  as  full-time  students  in  a  credit  program  on  September  30  (or  an  earlier  date  at  which  the 
number  of  freshmen  commencing  a  program  can  be  reasonably  determined)  and  who  were  still 
enroled,  either  full-time  or  part-time,  on  December     of  the  same  year. 

Attrition  -  The  number  of  freshman  students  who  were  enroled  as  full-time  students  in  a  credit  program 
on  September  30  (or  an  earlier  date  at  which  the  number  of  freshmen  commencing  a  program  can  be 
reasonably  determined),  minus  the  number  who  were  still  enroled,  either  full-time  or  part-time,  on 
December  1^'  of  the  same  year. 

Retention  rate  -  The  proportion  of  full-time  students  commencing  a  program  as  of  September  30^  who 
are  still  active  at  the  institution,  full-time  or  part-time  in  any  program. 

#  enroled  full-time  December  1  (Year  x)  -  The  number  of  students  in  a  program  who  are  enroled  full- 

time  in  any  credit  program  on  December  1  of  the  year  in  which  they  commenced  study  as  freshmen. 

#  enroled  December  1  (Yearx+1)  -  The  number  of  students  enroled  full-time  or  part-time  in  any  credit 

program  on  December  1  of  the  year  following  the  year  in  which  they  commenced  study  as  freshmen. 

Enroled  as  %  of  freshmen  December  1  (Year  x)  -  The  number  of  students  enroled  December  1  (Year 
x+1)  expressed  as  a  percentage  of  the  number  enroled  full-time  on  December  1  (Year  x). 

#  of  full-time  freshman  students  as  of  December  1  (Yearx)  who  did  not  return  -  The  number  of  full-time 

freshman  students  December  1  (Year  x)  minus  the  number  enroled  December  1  (Year  x-hl), 
categorized  as  follows: 

Required  to  Withdraw  -  Not  permitted  to  continue  in  the  program  due  to  inadequate  academic 
performance.  (Number  and  Percentage  of  "Total  Not  Returning")- 

Transfers  to  AB  PSIs  -  Students  identified  through  the  ACAT  Duplicate  Application  Detection 
project  database  as  attending  another  Alberta  post-secondary  institution  in  the  Fall  of  Year  x-i-1. 
(Number  and  Percentage  of  "Total  Not  Returning"). 

Others  Not  Returning  -  Students  not  returning,  not  identified  in  either  of  the  above  categories. 
(Number  and  Percentage  of  "Total  Not  Returning"). 
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Generating  Freshman  Persistence  Elements  from  CIS  Data  -  The  following  steps  will  generate 
freshman  persistence  information  elements  from  CIS  data,  and  should  be  applicable  to  local  databases: 

1.  Identify  programs  for  which  freshman  persistence  rates  are  to  be  reported  and  classify  by  faculty. 

2.  For  each  program,  identify  the  full-time  freshman  students  on  September  30  of  the  base  year,  or  at  an 
earlier  date  at  which  the  number  of  full-time  freshmen  commencing  a  program  can  be  reasonably 
determined.  Exclude  unclassified  students. 

3.  For  each  program,  check  whether  the  full-time  freshmen  students  as  of  September  30'^  are  attending 
any  program  at  the  institution  as  of  December  V\  Count  the  numbers  who  are  enroled  and  active, 
full-time  or  part-time  at  the  institution  on  December  1  of  the  base  year. 

4.  For  each  program,  calculate  the  numbers  of  students  leaving  the  institution  between  September  30 
and  December  1 . 

5.  For  each  program,  calculate  the  retention  rate  by  expressing  the  number  of  students  at  December  1  as 
a  percentage  of  the  number  of  students  in  September. 

6.  For  each  program,  count  the  number  of  full-time  freshman  students  who  were  enroled  on  December  1 
of  the  base  year  (Year  x)  and  who  are  enroled  and  active,  full-time  or  part-time  in  any  credit  program 
on  December  1  of  the  subsequent  year  (Year  x-i-1). 

7.  For  each  program,  divide  the  number  enroled  on  December  1  of  Year  x+1  by  the  number  enroled  on 
December  1  of  the  base  year  and  express  the  result  as  a  percentage  (Column  7). 

8.  For  each  program,  count  the  number  of  full  time  freshman  students  who  were  enroled  as  of 
December  1  of  Year  x  who  did  not  return  for  the  following  Fall  session. 

9.  Identify  the  number  of  students  required  to  withdraw  and  express  this  number  as  a  percentage  of  the 
total  not  returning  for  the  program. 

10.  Provide  a  file  including  the  Duplicate  Application  Detection  data  elements  for  the  remaining  students 
to  the  Alberta  Council  on  Admissions  and  Transfer  office.  AC  AT  will  return  the  file  showing  the 
institution  and  program  of  attendance  for  those  attending  an  Alberta  post-secondary  institution  in  the 
Fall  of  Year  x+1. 

1 1 .  For  each  program,  count  the  number  of  students  identified  in  the  AC  AT  data  as  attending  another 
Alberta  PSI  in  the  Fall  of  Year  x+1  and  express  this  number  as  a  percentage  of  the  total  not  returning 
for  the  program. 

12.  Record  the  number  of  students  not  counted  in  Step  9  or  Step  1 1  as  "others  not  returning"  and  express 
this  number  as  a  percentage  of  the  total  not  returning. 

Athabasca  University: 

This  indicator  is  not  being  reported  by  Athabasca  University.  AU  will  report  the  number  of  successful 
course  completions  for  all  students  (See  Athabasca  University  format  re:  Program  Completion  indicator  - 
Page  32). 


KPI  Reporting  Manual  -  November  1997 


Page  41 


Revisions  to  15/12/97 


KPI  Reporting  Manual  -  November  1997  Page  42  Revisions  to  15/12/97 


UNIVERSITY  TRANSFER  PROGRAM  LEAVERS 


The  purpose  of  this  indicator  is  to  provide  information  with  respect  to  the  performance  of 
approved  University  Transfer  programs  at  the  seven  colleges  with  such  programs.  Two 
important  rates  traditionally  used  by  the  department  and  Alberta  Council  on  Admissions  and 
Transfer  (ACAT)  will  be  calculated  and  reported  so  as  to  reflect  the  various  possible  outcomes 
of  a  University  Transfer  program  -  the  percentage  of  the  total  number  of  full-time  students  in  a 
University  Transfer  program  that  transfer  in  a  subsequent  year,  and  the  percentage  of  leavers 
that  transfer  after  leaving  the  program. 

Transfers  to  Alberta  universities  or  private  colleges  with  accredited  degree  programs  will  be 
included  in  the  calculation.  Supplementary  data  are  being  collected  and  separate  calculations 
may  be  done  for  transfers  to  degree-level  programs  and  to  other  programs  at  "Other  Alberta 
Post-Secondary  Institutions"  (Colleges  and  Technical  Institutes). 

Because  Lakeland  College  is  funded  specifically  as  an  inter-provincial  college,  and  because 
auditable  data  is  available,  its  transfers  to  universities  in  Saskatchewan  will  be  included. 


Indicator(s)  Apply  to: 

Transfer  rates  to  Alberta  universities  and 

private  colleges 
Transfer  rates  to  other  Alberta  post-secondary 

institutions 


Colleges  &  Technical 
Institutes 


Universities 


Private  Colleges 


Level  of  Reporting:  By  program  at  the  CIS  Standard  Name  level.  [See  Page  15] 

Scope:  The  nine  approved  University  Transfer  programs  at  the  seven  Public 

Colleges  which  offer  such  programs:  UT:  Bachelor  of  Arts,  UT: 
Bachelor  of  Business  Administration,  UT:  Bachelor  of  Education,  UT: 
Bachelor  of  Engineering,  UT:  Bachelor  of  Fine  Arts,  UT:  Bachelor  of 
Physical  Education,  UT:  Bachelor  of  Science,  UT:  Bachelor  of  Social 
Work,  UT:  General. 
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Data  Elements  &  Reporting  Systems: 


University  transfer  program 
"Cohort"  (Enrolment  in  Year  x) 
Status  at  college  -  Fall  of  Year  x+1  - 

Same  UT  program 

Other  UT  program 

Other  degree  program 

Other  program 

Left  the  college 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

CIS 
CIS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 


Attending  Alberta  university  or  private  college 

-Year  x+1  KPIRS 
Attending  Alberta  university  or  private  college 

-  Year  x+2  KPIRS 
Attending  other  Alberta  post-secondary 

institution  -  Year  x+1  -  degree-level  KPIRS 
Attending  other  Alberta  post-secondary 

institution  -  Year  x+2  -  degree-level  KPIRS 
Attending  other  Alberta  post-secondary 

institution  -  Year  x+1  -  other  programs  KPIRS 
Attending  other  Alberta  post-secondary 

institution  -  Year  x+2  -  other  programs  KPIRS 


Specifications  &  Protocols: 

"Cohort"  (Enrolment  in  Year  x)  -  The  number  of  full-time  students  in  a  University  Transfer  program  in 
a  given  year  as  recorded  in  CIS.  Students  new  to  the  institution  later  than  the  Fall  session  are 
excluded  unless  in  a  compressed  program  designed  for  transfer  in  the  following  Fall  (Year  x+1). 

Cohort  reference  year  -  The  academic  year  of  attendance  of  the  cohort.  Usually  the  year  prior  to  the 
reporting  year. 

Status  at  college  -  Fall  of  Year  (x+1)  -  The  enrolment  status  of  students  in  the  cohort  at  the  college,  in 
the  Fall  of  Year  (x+1),  the  year  following  the  cohort  reference  year.  Headcount  measures  of  the 
number  of  students  attending  the  following  types  of  programs: 

Same  UT  program  -  Continuing  in  the  same  UT  program  as  in  Year  (x). 

Other  UT  program  -  Enroled  in  a  different  UT  program. 

Other  degree  program  -  Enroled  in  a  degree-level  program  (applied  degree  programs,  collaborative 
nursing,  and  certain  brokered  degree  programs)  at  the  college. 

Other  program  -  Enroled  in  a  program  other  than  a  UT  or  degree-level  program. 

Left  the  college  ("Leavers")  -  Not  enroled  at  the  college  in  Year  (x+1). 

Attending  an  Alberta  university  or  private  college  with  accredited  degree  programs  -  Year  (x+1),  Year 
(x+2)  -  "Headcount"  measures  of  the  number  of  "leavers"  from  a  university  transfer  program  in  one 
year  who  are  enroled  in  a  degree  program  at  an  Alberta  university  or  private  college  with  accredited 
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degree  programs  in  each  of  the  next  two  years,  as  identified  in  the  ACAT  Duplicate  Application 
Detection  database  for  the  Fall  session. 

Attending  other  Alberta  post-secondary  institutions  -  Year  (x+1),  Year(x-\-2)  -  "Headcount"  measures 
of  the  number  of  "leavers"  from  a  program  in  one  year  who  are  enroled  in  a  program  at  an  Alberta 
institution  other  than  a  university  or  a  private  college  with  accredited  degree  programs,  in  each  of  the 
next  two  years,  as  identified  in  the  ACAT  Duplicate  Application  Detection  data  for  the  Fall  session. 
Data  will  be  segregated  for  degree-level  programs  (applied  degree  programs,  collaborative  nursing, 
certain  brokered  degree  programs  and  the  Fine  Arts  degree  offered  by  ACAD)  and  for  other 
programs. 

Transfer  rates  -  Various  rates  of  transfer  and  continuation  will  be  calculated  to  show  the  flow  out  of  the 
UT  program  to  the  various  destinations,  the  primary  destination  being  transfer  to  university.  Two 
denominators  are  available  for  calculating  the  rates,  the  UT  cohort  itself,  and  the  portion  of  the  cohort 
that  did  not  return  to  the  institution  [Leavers].  Insofar  as  the  intent  is  to  track  the  entire  "cohort"  as 
defined  above,  the  "cohort"  will  be  the  primary  denominator.  Rates  calculated  for  the  number  of 
students  transferring  in  Year  (x+1)  can  be  updated  by  using  the  total  number  of  transfers  for  Year 
(x+1)  and  Year  (x+2)  when  the  latter  become  available. 

Generating  University  Transfer  Elements  from  DAD  Database  -  CIS  will  be  used  to  identify  "cohorts" 
of  full-time  university  transfer  program  students  for  a  given  year  for  each  institution.  Institutions  will  use 
this  data  to  prepare  a  "leavers"  file,  including  an  identifier  which  will  enable  location  of  the  student  in 
the  Alberta  Council  of  Admissions  and  Transfer  (ACAT)  Duplicate  Application  Detection  (DAD) 
database,  if  attending  an  Alberta  university,  private  college  or  any  other  Alberta  post- secondary 
institution  in  either  of  two  subsequent  years. 

1 .  CIS  will  be  used  to  provide  each  institution  with  University  Transfer  Programs  with  a  list  of  those 
enroled.  Students  who  entered  in  winter  or  spring  sessions  will  be  omitted,  since  they  are  not  likely 
to  have  earned  24  transfer  credits.  However,  students  entering  new  intensive  transfer  programs  — 
beginning  in  Jan/Mar.  and  enabling  students  to  transfer  in  September  ~  will  be  added  to  the  cohort 
beginning  with  the  1995-96  cohort.  This  establishes  the  "cohort"  for  the  "cohort  reference  year" 
which  usually  will  be  the  year  prior  to  the  reporting  year. 

2.  Each  institution  will  use  this  list  to  prepare  a  "leavers"  file  in  ACAT  Duplicate  Application 
Detection  format  with  the  following  elements: 

Cohort  reference  year  (7  character  field,  e.g.,  1995-96) 
Institution  code 
DAD  ID 

CIS  Standard  Name 

CIS  Student  ID 

Status  at  College  -  "L"  =  leaver 

"S"  =  same  program 
"U"  =  other  UT  program 
"D"  =  other  degree-level  program 
"C"  =  another  College  program 

and  forward  the  file  to  ACAT. 

3.  AECD  will  provide  ACAT  with  a  current  list  of  degree-level  programs  at  colleges  and  technical 
institutes. 

4.  ACAT  will  run  "leavers"  files  for  current  and  prior  years  against  the  DAD  database  and  produce 
reports  showing  the  institution  and,  where  possible,  the  program  of  attendance  for  those  students 
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attending  Alberta  institutions  and  will  report  this  information  back  to  the  "sending"  and  "receiving" 
institutions. 

5.   Institutions  will  prepare  KPI  indicator  data  for  AECD  and  enter  through  KPIRS. 

Note  re:  Transfer  to  Institutions  Outside  Alberta  -  There  are  no  system-level  sources  for  the 
information  regarding  student  transfer  to  institutions  outside  Alberta.  Graduate  and/or  leaver  follow-up 
studies  undertaken  by  each  institution  may  provide  data  to  support  a  note,  commentary  and/or  estimates, 
particularly  where  there  are  established  relationships,  paths  or  patterns  of  transfer.  As  noted  above,  the 
official  transfer  rate  for  Lakeland  College  will  include  transfers  to  universities  in  Saskatchewan,  to  the 
extent  that  the  data  is  supported  by  auditable  records.  In  preparing  its  report,  Lakeland  College  should 
include  transfers  to  universities  in  Saskatchewan  and  maintain  auditable  records  of  the  source  data  and 
calculations. 
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TRANSFER  STUDENT  PERFORMANCE 


This  indicator  deals  with  the  question  of  how  students  who  first  attend  a  university  transfer  program  at 
an  Alberta  public  college  subsequently  perform  at  university  by  measuring  the  number  who  are 
successful  in  their  first  year  following  transfer  to  a  university  program. 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Indicator(s)  Apply  to: 

Percentage  of  transferees  successful  in  Year  1 


Level  of  Reporting:  CIS  Standard  Name  level.  [See  Page  15]. 

Scope:  Information  required  for  programs  to  which  students  are  admitted  on  the 

basis  of  academic  work  completed  in  a  university  transfer  program  at 
one  of  the  seven  Alberta  public  colleges  with  approved  university 
transfer  programs. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  ttirough  (or  calculated  by) 

Sending  institution 

XL  Templates 

KPIRS 

Receiving  program 

XL  Templates 

KPIRS 

Number  of  transferees 

XL  Templates 

KPIRS 

Number  successful  in  Year  1 

XL  Templates 

KPIRS 

Number  successful  in  Year  1  /  Number  of 

transferees 

XL  Templates 

KPIRS 

Specifications  &  Protocols: 

The  Alberta  Council  on  Admissions  and  Transfer  will  provide  each  university  with  a  file  containing 
records  for  students  who  are  new  to  the  university  in  the  Fall  of  each  year  and  who  were  leavers  from  a 
University  Transfer  program  at  one  of  the  seven  public  colleges  offering  university  transfer  programs,  in 
one  of  the  two  prior  years.  Each  record  will  be  in  the  Duplicate  Application  Detection  project  format. 
These  students  will  constitute  the  Transfer  Cohort  in  each  reporting  year. 

The  Transfer  Cohort  will  be  tracked  to  account  for  the  number  of  students  who  have  not  withdrawn  and 
are  eligible  to  continue  (in  good  standing),  at  the  end  of  their  first  year  following  transfer. 

Sending  Institution  -  One  or  more  of  the  following  public  colleges  which  offers  AECD  approved 

university  transfer  programs:  Grande  Prairie  Regional  College,  Grant  MacEwan  Community  College, 
Keyano  College,  Lakeland  College,  Medicine  Hat  College,  Mount  Royal  College,  Red  Deer  College. 
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Receiving  Program  -  The  undergraduate  degree  program  to  which  a  student  is  admitted  on  the  basis  of 
academic  work  completed  in  a  university  transfer  program  at  a  sending  institution. 

#  of  Transferees  -  The  number  of  full-time  students  who  left  a  college  university  transfer  program  in 

one  of  the  two  previous  years  and  who  are  in  their  first  session  of  attendance  following  admission  to  a 
receiving  institution.  The  group  of  "university  transfer  leavers"  is  defined  by  the  University  Transfer 
Program  Leavers  KPI.  The  group  of  "transferees"  will  be  identified  through  the  ACAT  Duplicate 
Application  Detection  Project  database  and  will  constitute  the  Transfer  Cohort  for  each  year  of 
reporting. 

#  Successful  in  Year  1  -  The  number  of  students  in  a  transfer  cohort  who  have  not  withdrawn  and  are 

eligible  to  continue  with  undergraduate  study  at  the  end  of  their  first  year  after  transfer. 

#  Successful  in  Year  7  /  #  of  Transferees  -  The  proportion,  expressed  as  a  percentage,  of  the  transfer 

cohort  who  have  not  withdrawn  and  are  eligible  to  continue. 
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TRANSFERABILITY  of  COURSES 


The  purpose  of  this  indicator  is  to  provide  some  indication  of  the  transferability  of  courses 
among  Alberta  colleges  and  technical  institutes  and  Alberta  universities  and  private  colleges 
with  accredited  degree  programs.  Information  provided  through  the  Transfer  Guide  published 
annually  by  the  Alberta  Council  on  Admissions  and  Transfer  will  be  analyzed  to  provide 
quantitative  indicators  of  the  extent  of  transferability  of  courses  and  multi-course  transfer 
agreements. 


Indicator(s)  Apply  to: 

Colleges  &.  Technical 
Institutes 

Universities 

Private  Colleges 

Number  of  courses  accepted  by  1,  2,  3,  or 

more  Alberta  universities  or  private 

X 

colleges 

Number  of  transfer  agreements 

X 

Level  of  Reporting:  By  institution  at  the  total  institution  level. 

Scope:  Transferability  indicator  information  will  be  generated  for  the  Colleges 

and  Technical  Institutes  included  as  "sending"  institutions  in  the  Alberta 
Council  on  Admissions  and  Transfer's  Transfer  Guide  database. 


Data  Elements  &  Reporting  Systems: 


Number  of  transfer  courses  accepted  by: 
One  receiving  institution 
Two  receiving  institutions 
Three  receiving  institutions 
More  than  three  institutions 

Number  of  transfer  agreements 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

ACAT/KPIRS 
ACAT/KPIRS 
ACAT/KPIRS 
ACAT  /  KPIRS 
ACAT/KPIRS 


Specifications  &  Protocols: 

KPI  information  regarding  the  transferability  of  courses  from  Colleges  and  Technical  Institutes  to 
Alberta  universities  and  private  colleges  with  accredited  degree  programs  will  be  generated  from  an 
analysis  of  the  current  and  two  prior  years'  editions  of  the  Alberta  Council  on  Admissions  and  Transfer's 
Transfer  Guide  database,  with  results  reported  for  each  "sending"  institution.  This  information  will  be 
prepared  by  ACAT  using  the  following  specifications: 

Sending  Institution  -  An  Alberta  post-secondary  institution  from  which  students  are  transferring. 

Transfer  Course  -  A  course  or  cluster  of  courses  included  in  the  ACAT  Alberta  Transfer  Guide  database 
for  which  there  are  transfer  agreements  to  one  or  more  Alberta  universities  or  private  colleges  with 
accredited  degree  programs. 
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Number  of  Courses  Accepted  -  Number  of  courses  accepted  for  transfer  credit  by  at  least  one  of  the  four 
Alberta  universities  or  a  private  college  with  accredited  degree  programs. 

Receiving  Institution  -  An  Alberta  university  or  private  college  with  accredited  degree  programs. 

Number  of  Transfer  Agreements  -  The  total  number  of  transfer  agreements  (one  per  receiving  institution 
per  course)  between  a  "sending  institution"  an  Alberta  university  or  private  college  with  accredited 
degree  programs,  as  recorded  in  the  ACAT  Alberta  Transfer  Guide  database.  One  transfer  course  may 
be  involved  in  up  to  eight  transfer  agreements. 

Generating  Transferability  Elements  -  ACAT  maintains  a  database  of  transfer  agreements  negotiated 
between  post-secondary  institutions  in  the  province.  From  this  source,  ACAT  produces  the  Alberta 
Transfer  Guide  which  contains  tables  for  each  Alberta  public  college  and  technical  institute.  For  each 
applicable  public  college  and  technical  institute  transfer  course,  the  Guide  shows  the  courses  and  their 
credit  weight  which  are  awarded  by  one  or  more  receiving  institutions  for  each  of  those  courses. 
Therefore,  for  each  college  and  technical  institute,  the  number  of  courses  that  are  transferable  to  one, 
two,  three  and  four  or  more  Alberta  university  or  private  colleges  with  accredited  degree  program  can  be 
counted. 

This  information  will  be  prepared  by  ACAT,  and  made  available  for  institutional  review  through  KPIRS. 
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GRADUATING  STUDENT  SATISFACTION 

Satisfaction  indicators  are  compiled  from  the  results  of  surveys  of  students  who  are  about  to 
graduate  from  each  Alberta  post-secondary  institution  to  determine  satisfaction  with,  and  self- 
reported  benefits  from,  the  education  received.  Results,  to  be  reported  by  program,  include  a 
number  of  indicators  common  to  all  AECD  sectors. 


Indicator(s)  Apply  to: 

Colleges  &  lecnnical 

Universities 

Private  Colleges 

Institutes 

%  of  completers  satisfied  with  the  overall 

quality  of  their  educational  experience 

X 

X 

X 

%  who  would  select  same  program 

X 

X 

X 

%  who  would  select  same  institution 

X 

X 

X 

%  of  completers  satisfied  with  the  quality  of 

teaching/instruction- 

X 

X 

•   in  their  own  faculty 

X 

•  in  other  faculties 

X 

%  of  completers  reporting  benefits  - 

•    for  continuing  education 

X 

X 

X 

•   academic  benefit  /  in-depth  knowledge 

in  a  field 

X 

X 

X 

•   skills  needed  for  employment 

X 

X 

X 

•   improved  chances  of  good  income 

X 
X 

X 
X 

X 
X 

•    opportunity  for  personal  development 

%  of  completers  satisfied  with  overall 

X 

X 

X 

program  relevancy 

Level  of  Reporting:  Graduating  student  satisfaction  information  is  required  by  program  for 

all  parchment  programs: 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD. 

Vocational  Colleges  -  at  CIS  Standard  Name  level. 

Universities  -  at  CIS  Standard  Name  level. 

Private  Colleges  -  at  CIS  Standard  Name  level. 
For  Preparatory  &  Basic  Upgrading  (PBU)  program  areas  -  data  is 
required  at  the  CIS  Standard  Name  level.  [See  Page  15] 


Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree  and  Bachelor  Degree,  plus  Preparatory  &  Basic 
Upgrading.  [See  Page  16] 
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Data  Elements  &  Reporting  Systems: 


Program 

#  of  Completers  (Graduates) 

#  of  Responses 

#  who  would  select  same  program 

#  who  would  select  same  institution 

#  reporting  satisfaction  {fully  satisfied  / 
somewhat  satisfied  /  not  at  all  satisfied  /  no 
answer}: 

Relevancy  of  courses 
Quality  of  teaching 

Overall  quality  of  experience  


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

For  ESL  &AU programming: 


Taught  what  needed  to  learn 
Quality  of  teaching  good 
Help  to  achieve  goals 
Overall  satisfied  with  school 


#  reporting  satisfaction  { very  satisfied  / 
satisfied  /  neither  satisfied  nor  dissatisfied  / 
dissatisfied  /  very  dissatisfied  /  no  answer} 

Quality  of  overall  educational  experience 
Overall  relevance 
Quality  of  instruction  own  Faculty 
Quality  of  instruction  other  Faculties 

#  reporting  benefits  { a  great  deal  /  somewhat  / 
not  at  all  /  not  applicable} 

Skills  needed  for  particular  job 
In-depth  knowledge  of  field  of  study 
Opportunity  to  improve  generally 
Improved  chances  of  good  income 
Allowed  to  continue  education 


For  ESL  programming: 


Ability  to  communicate  in  English 
More  confident  in  using  English 
Help  to  learn  about  Canadian  culture 


For  other  PBU  programming 


Knowledge  to  prepare  for  job 
Prepared  to  go  on  to  further  education 
Ability  to  study  and  solve  problems 
Improved  feelings  -  self  and  outlook 
Get  along  better  with  most  people 
Skills  needed  to  find  and  keep  job 


#  reporting  benefits  {strongly  agree  /  agree  / 
neither  agree  nor  disagree  /  disagree  / 
strongly  disagree  /  no  answer} 
Qualify  for  another  program 
In-depth  knowledge  of  field  of  study 
Skills  needed  for  particular  career 
Improved  possibility  of  good  income 
Opportunity  for  personal  development 


CIS 
CIS/KPIRS 
KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 
XL  Templates 


CIS 
CIS/KPIRS 
KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
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Specification  &  Protocols: 

1995-96  satisfaction  indicator  data  for  universities  and  private  colleges  were  reported  from  the  results 
of  exit  surveys  undertaken  when  students  were  at  the  point  of  completing  a  program  and  leaving  the 
institution.  Data  for  parchment  programs  at  colleges  and  technical  institutes  were  reported  from 
follow-up  surveys  conducted  by  each  institution  six  to  nine  months  after  graduation.  For  1996-97 
colleges  &  technical  institutes  have  also  implemented  exit  surveys  and  will  report  results  from  both  the 
follow-up  surveys  of  1995-96  graduates  and  the  exit  surveys  of  1996-97  graduates. 

Statistical  Adjustment 

Survey  results  are  adjusted,  using  standard  statistical  methods,  to  compensate  for  differences  in 
institutional  survey  populations  and  response  rates.  A  description  of  the  methods  used  is  available  from 
the  AECD  System  Information  branch. 

Survey  Methodology  &  Common  Questions  -  Colleges  &  Technical  Institutes  - 

1.  Timing  -  an  exit  survey  conducted  at  graduation.  This  may  be  done  in  class  in  the  last  days  of  the 
program  period,  or  as  a  mail  or  telephone  survey  immediatelv  following  program  completion. 

2.  Reporting  -  the  following  table  provides  details  about  the  transition  from  the  reporting  process  and 
schedule  outlined  in  the  May  1995  Manual  and  that  called  for  under  the  approach  now  to  be 
followed: 


Datev;^rVi-:vv 

Survey  Period: 

October  1996  - 
March  1997 

Satisfaction  and  Employment  Data: 

Institutions  are  expected  to  have 
conducted  follow-up  surveys  of  their 
1995-96  parchment  &  PBU  grads  for 
employment  and  *  satisfaction 
information.  *(Follow-up  Satisfaction 
data  was  collected  as  the  change  to  exit 
surveys  was  not  implemented  in  time  to 
survey  1995-96  grads  on  exit.) 

1995-96  grads  (follow-up) 
Employment  and  Satisfaction 
data  to  be  reported  in  January 
1998. 

Survey  Period: 

1996-97  -June  1997 

Satisfaction  Data:  Exit  survey  on 
Satisfaction  -  for  parchment  and  PBU 
students 

1996-97  (exit)  Satisfaction  data 
also  to  be  reported  January  1998. 

Survey  Period: 

October  1997  - 
March  1998 

Employment  Data:  Employment 
Follow-up  survey  for  1996-97 
parchment  &  PBU  completers 

1996-97  (follow-up)  employment 
data  reported  January,  1999. 

Survey  Period: 

1997-98  -June  1998 

Satisfaction  Data:  Exit  survey  on 
Satisfaction  -  for  parchment  and  PBU 
students 

1997-98  (exit)  Satisfaction  data 
also  to  be  reported  in  January 
1999. 

3.   Sampling  -  all  students  who  indicate  at  the  end  of  the  program  period  that  they  expect  to  graduate 
(complete  the  program).  See  "Special  Note  #1"  below. 


4.  Institutions  to  provide  AECD  a  copy  of  survey  instrument  with  report. 

5.  Data  should  be  reported  in  "numbers"  as  indicated  by  the  "#"  symbol  in  the  formats  above. 

6.  Administration  of  the  survey  instrument  by  telephone  is  acceptable,  but  may  require  some  adjustment 
to  the  wording  of  the  questions.  In  making  changes  to  improve  the  flow  of  the  instrument,  care 
should  be  taken  NOT  to  change  the  intent  or  meaning  of  questions. 

7.  If  any  adjustment  to  a  common  question  is  necessary,  all  colleges  and  technical  institutes  and  AECD 
should  be  consulted  prior  to  implementation  of  the  change. 
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Special  Note  1:  If  institutions  survey  students  during  the  last  couple  of  weeks  of  their  parchment 
program,  they  will  not  always  know  which  students  will  graduate.  However,  this  does  not  mean 
institutions  will  have  to  ask  students  to  include  their  names  on  the  survey  and  then  check  each 
individual  to  see  if  they  graduated.  The  set  of  people  surveyed  for  satisfaction  need  not  be  exacdy 
the  same  as  the  set  of  people  surveyed  for  employment.  The  same  consideration  applies  to  the 
Preparatory  &  Basic  Upgrading  programs. 

Special  Note  2:  In  PBU  programs,  especially,  there  are  course  completers,  goal  completers,  and 
program  completers.  And  there  are  level  completers  within  a  program;  and  completers  of  entire 
programs.  Given  this  complexity,  which  type  of  completer  will  be  completing  the  satisfaction 
questions  at  the  point  of  exit?  Should  institutions  survey  individuals  who  only  take  one  course  all 
year?  once  for  each  course  they  take  in  a  year?  And  some  institutions  have  two  or  more  levels  in 
which  each  level  contains  several  areas  of  study  (math,  social  studies,  reading,  and  writing);  does  this 
mean  a  survey  for  each  area  of  study  at  each  level? 

These  questions  reflect  the  uncertainty  about  what  is  an  PBU  "completer"  among  and  within 
institutions.  The  lack  of  standardization  across  the  system  complicates  matters.  To  deal  with  this, 
institutions  are  to  survey  students  when  they  finish  a  program  (identified  by  ProgID  or,  at  the  AVCs, 
by  Standard  Name).  Students  who  move  from  one  to  another  ProgID  during  a  year  without 
completing  a  program  are  to  be  surveyed  when  they  complete  a  year  of  study  in  a  program  area  or 
multi-level  program.  The  overriding  consideration  is  that  graduating  students  are  not  to  be  surveyed 
twice  in  any  reporting  year  unless  they  complete  two  separate  programs  (programs  with  different 
ProglDs  or  Standard  Names). 

Questions  Included  in  the  Survey 

Inclusion  of  the  following  questions  in  exit  surveys  conducted  by  individual  institutions  provides  the 
information  required  by  AECD  regarding  graduating  student  satisfaction.  Each  institution  is  to  use  the 
questions  as  worded,  but  may  order  the  questions  as  appropriate  in  relation  to  other  elements  of  a  larger 
survey  instrument.  Particularly  with  respect  to  Preparatory  &  Basic  Upgrading  programs,  where  the 
questionnaire  developed  by  an  institution  includes  many  questions  beyond  those  necessary  for  KPI 
purposes,  it  is  recommended  that  KPI  questions  be  placed  in  a  cluster  of  related  questions  so  that 
respondents  will  answer  the  questions  within  a  context  that  has  been  established  by  these  other  questions. 

1.  Do  you  believe  that  your  program  improves  your  chances  of  getting  a  job? 

□  A  great  deal  □  Somewhat 

□  Not  at  all 

2.  After  attending  the  program: 


Would  you  choose  the  same  program  again? 

□  Yes 

□  No 

Would  vou  20  to  (Name  of  Institution)  again? 

□  Yes 

□  No 

How  satisfied  were  you  with  your  program? 

Fully 

Somewhat 

Not  at  all 

ESL  and  ACADEMIC  UPGRADING  ONLY: 

satisfied 

satisfied 

satisfied 

The  program  taught  you  what  you  needed  to  learn 

□ 

□ 

□ 

Quality  of  teaching  was  good. 

□ 

□ 

□ 

The  program  helped  you  to  achieve  your  goals. 

□ 

□ 

□ 

Overall,  you  were  satisfied  with  the  school. 

□ 

□ 

□ 

Fully 

Somewhat 

Not  at  all 

"PARCHMENT"  PROGRAMS  ONLY: 

satisfied 

satisfied 

satisfied 

Relevancy  of  your  courses 

□ 

□ 

□ 

Quality  of  teaching 

□ 

□ 

□ 

Overall  quality  of  educational  experience 

□ 

□ 

□ 
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4.  To  what  extent  did  the  program  provide  you  with  the  following  benefits? 


A  Great 

Not 

ESL  STUDENTS  ONLY: 

deal 

Somewhat 

Not  at  all 

applicable 

I  am  satisfied  that  the  program  improved  my  ability  to 

communicate  in  English. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  helped  me  feel  more 

confident  in  using  Enghsh. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  helped  me  learn  about 

Canadian  customs  &  culture. 

□ 

A  Great 

□ 

□ 

□ 

Not 

OTHER  PREPARATORY  &  BASIC  UPGRADING: 

deal 

Somewhat 

Not  at  all 

applicable 

I  am  satisfied  that  the  program  taught  me  knowledge  needed 

to  prepare  for  a  job. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  prepared  me  to  go  on  to 

further  education  or  training. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  improved  my  ability  to  study 

and  solve  problems. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  improved  my  feelings  about 

myself  and  my  outlook  on  life. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  helped  me  get  along  better 

with  most  people. 

□ 

□ 

□ 

□ 

I  am  satisfied  that  the  program  gave  me  skills  needed  to  find 

and  keep  a  job. 

□ 

A  Great 

□ 

□ 

□ 

Not 

"PARCHMENT"  STUDENTS  ONLY: 

deal 

Somewhat 

Not  at  all 

applicable 

Skills  needed  for  a  particular  job 

□ 

□ 

□ 

□ 

In-depth  knowledge  of  a  field  of  study 

□ 

□ 

□ 

□ 

An  opportunity  to  improve  yourself  generally 

□ 

□ 

□ 

□ 

Improved  your  chances  of  a  good  income 

□ 

□ 

□ 

□ 

Allowed  you  to  continue  your  education 

□ 

□ 

□ 

□ 

These  questions  will  be  reviewed  annually  and  amended  or  updated  in  consultation  with  the  Senior 
Student  Services  Officers'  committee  of  the  Council  of  Presidents. 

Survey  Methodology  &  Common  Questions  -  Universities 

1 .  Timing  -  a  survey  administered  to  graduating  students  at  the  end  of  the  year  in  which  they  are 
completing  a  program  and/or  requirements  for  graduation.  The  universities'  survey  is  not  conducted 
every  year.  It  was  last  conducted  in  the  Spring  of  1996.  The  results  of  this  survey  will  be  reported 
each  year  until  the  next  survey  is  conducted. 

2.  Reporting  schedule  -  reports  to  be  submitted  in  alternate  years  for  survey  results  in  the  year  prior, 
in  above  formats. 

3.  Sampling  -  stratified  random  sample  across  all  degree,  diploma,  and  certificate  programs.  The 
sample  should  be  of  sufficient  size  to  provide  results  for  each  university 

4.  A  survey  is  being  undertaken  jointly  by  three  universities  (Alberta,  Calgary,  and  Lethbridge)  on  a 
biennial  basis.  Athabasca  University  is  undertaking  an  annual  survey  of  all  students. 

5.  The  joint  survey  instrument  used  in  the  spring  of  1996  will  vary  from  survey  to  survey,  since  it 
includes  questions  that  each  university  wants  to  have  answered  for  its  own  planning  purposes. 
However,  for  KPI  reporting  purposes,  the  universities  have  agreed  that  the  common  questions  needed 
to  produce  KPI  data  required  by  AECD  will  be  included  in  each  survey. 

6^  Results  should  be  reported  numerically  (i.e.,  the  number  of  responses  rather  than  the  percentage  of 
respondents). 
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X   For  data  elements  "Would  select  same  Program"  and  "Would  select  same  University",  the  numbers 
of  "Yes"  and  "Maybe"  responses  should  be  combined  for  reporting. 

The  survey  instrument  last  used  (Spring  1996)  by  the  universities  is  attached  as  Appendix  B. 

Survey  Methodology  &  Common  Questions  -  Private  Colleges 

1 .  Timing  -  a  survey  administered  to  graduating  students  at  the  end  of  the  year  in  which  they  are 
completing  a  program  and/or  requirements  for  graduation.  Note  that  if  the  survey  is  not  conducted 
every  year,  the  results  of  the  most  recent  survey  will  be  reported  each  year  until  the  next  survey  is 
conducted. 

2.  Reporting  schedule  -  reports  to  be  submitted  in  the  Fall  of  each  year  in  which  a  survey  is  undertaken. 

3.  Sampling  -  full  population  survey  across  all  degree,  diploma,  and  certificate  programs. 

4.  Survey  instruments  will  vary  from  survey  to  survey  and  from  year  to  year,  since  it  includes  questions 
that  each  institution  will  include  questions  for  its  own  planning  purposes.  However,  for  KPI 
reporting  purposes,  the  private  colleges  have  agreed  that  the  common  questions  needed  to  produce 
KPI  data  required  by  AECD  will  be  included  in  each  survey.  The  questions  needed  to  produce  KPI 
data  for  AECD  and  the  common  questions  used  most  recently  are  attached  as  Appendix  B. 

5.  Results  should  be  reported  numerically  (i.e.,  the  number  of  responses  rather  than  the  percentage  of 
respondents). 

6.  For  data  elements  "Would  select  same  Program"  and  "Would  select  same  Institution",  the  numbers 
of  "Strongly  Agree"  and  "Agree"  responses  should  be  combined  for  reporting. 

The  survey  instrument  last  used  (Spring  1996)  by  the  private  colleges  is  attached  as  Appendix  C. 

Re:  Entering  Data  in  KPIRS 

Different  scales  and  terms  for  responses  have  been  used  for  Colleges  and  Technical  Institutes, 
Universities,  and  Private  Colleges.  The  following  table  sets  out  the  "correspondence"  of  these  scales  and 
terms  for  KPIRS  data  entry:   


5 

4 

3 

2 

1 

0 

Colleges  &  Technical  Institutes  - 
Satisfaction 

fully 
satisfied 

somewhat 
satisfied 

not  used 

not  at  all 
satisfied 

not  used 

no 
answer 

Colleges  &  Technical  Institutes  - 
Benefits 

a  great 
deal 

somewhat 

not  used 

not  at  all 

not  used 

not 
applicable 

Universities  -  Satisfaction 

very 
satisfied 

satisfied 

neither 
/  nor 

dissatisfied 

very 
dissatisfied 

no 
answer 

Universities  -  Benefits 

strongly 
agree 

agree 

neither 
/  nor 

disagree 

strongly 
disagree 

no  answer 

Private  Colleges  -  Satisfaction 

very 
satisfied 

satisfied 

neither 
/  nor 

dissatisfied 

very 
dissatisfied 

no 
answer 

Private  Colleges  -  Benefits 

definitely 
provided 

provided 

uncertain 

did  not 
provide 

definitely 
did  not 
provide 

no  answer 

Private  Colleges  -  Rating  Aspects 

excellent=5 

4 

3 

2 

poor=l 

no  answer 
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GRADUATE  EMPLOYMENT  and  ACADEMIC  OUTCOMES 


The  purpose  of  this  information  set  is  to  determine  the  extent  to  which  graduates  of  career, 
professional,  training  and  general  programs  find  employment  related  to  their  education  and 
training  within  a  reasonable  period  of  time,  pursue  post-graduate  academic  objectives  or  have 
intentions  to  do  so.  Data  are  reported  from  the  results  of  follow-up  surveys  of  graduates,  six  to 
nine  months  after  graduation  in  from  College  &  Technical  Institute  programs  and  two  years  after 
graduation  from  University  and  Private  College  programs. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

#  of  labour  force  participants 

X 

X 

X 

%  labour  force  participation 

X 

X 

X 

#  employed 

Full-time 

X 

X 

X 

Part-time 

X 

X 

X 

In  jobs  directly  related 

X 

X 

X 

In  jobs  somewhat  related 

X 

X 

X 

In  jobs  not  related 

X 

X 

X 

%  employment  rate 

X 

X 

X 

#  unemployed  and  looking  for  work 

X 

X 

X 

Average  salary  of  those  employed  full-time 

X 

X 

X 

#  currently  enroled  in  a  post-secondary 

program  -  full-time 

X 

X 

X 

-  part-time 

X 

X 

X 

#  not  currently  enroled  but  will 

X 

X 

X 

Level  of  Reporting:  Graduate  employment  and  academic  outcomes  information  is  required 

by  program  for  all  parchment  programs: 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD. 

Vocational  Colleges  -  at  CIS  Standard  Name  level,  by  program 

length. 

Universities  -  at  CIS  Standard  Name  level,  by  program  length. 

Private  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 
For  Preparatory  &  Basic  Upgrading  (PBU)  program  areas  -  data  is 
required  at  the  CIS  Standard  Name  level.  [See  Page  15] 

Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree  and  Bachelor  Degree,  plus  Preparatory  &  Basic 
Upgrading.  [See  Page  16] 

Institutions  are  required  to  report  Preparatory  &  Basic  Upgrading 
information  beginning  with  the  1996-97  reporting  year. 
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Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

Program 

CIS 

XL  Templates 

CIS 

#  of  graduates  (completers) 

CIS 

XL  Templates 

CIS 

#  of  responses 

KFIRS 

XL  Templates 

KPIRS 

#  employed  full-time  (30+  hrs  per  week) 

KPIRS 

XL  Templates 

KPIRS 

#  employed  part-time  (<30  hrs  per  week) 

KPIRS 

XL  Templates 

KPIRS 

Total  employed 

KPIRS 

XL  Template 

KPIRS 

%  employment  rate 

KPIRS 

XL  Templates 

KPIRS 

#  unemployed  and  looking  for  work 

KPIRS 

XL  Templates 

KPIRS 

Total  in  labour  force 

KPIRS 

XL  Templates 

KPIRS 

%  labour  force  participation 

KPIRS 

XL  Templates 

KPIRS 

#  not  in  labour  force 

KPIRS 

XL  Templates 

KPIRS 

#  employed  in  jobs  directly  related 

KPIRS 

XL  Templates 

KPIRS 

#  employed  in  jobs  somewhat  related 

KPIRS 

XL  Templates 

KPIRS 

#  employed  in  jobs  not  related 

KPIRS 

XL  Templates 

KPIRS 

Average  salary  of  those  employed  full-time 

KPIRS 

XL  Templates 

KPIRS 

#  of  responses  re:  average  salary 

KPIRS 

XL  Templates 

KPIRS 

#  currently  enroled  in  a  post- secondary 

program  -  full-time 

KPIRS 

XL  Templates 

KPIRS 

-  part-time 

KPIRS 

XL  Templates 

KPIRS 

#  not  currently  enroled  but  will 

KPIRS 

#  with  no  immediate  plans 

KPIRS 

Specifications  &  Protocols: 

Follow-up  Survey  -  a  survey  conducted  six  to  nine  months  after  graduation. 

Program  Completer  (Graduate)  -  any  student  who  has  been  determined  by  the  institution  to  have 
completed  all  program  requirements  and  to  whom  the  institution  would  therefore  confer  a  parchment 
where  a  parchment  is  offered. 

Labour  Force  -  persons  who  are  employed,  or  unemployed  but  looking  for  work  at  the  time  of 
responding  to  a  graduate  survey. 

Employed  -  persons  who,  at  the  time  of  responding  to  a  graduate  survey,  did  any  work,  whether  full- 
time  or  part-time,  for  salary,  wages  or  self-employed,  permanent  or  temporary,  related  or  unrelated  to 
the  graduate's  program  of  study. 

Unemployed  -  persons  who,  at  the  time  of  responding  to  a  graduate  survey,  are  without  work  but  are 
actively  looking  for  work. 

Employment  Rate  -  the  number  of  employed  persons  expressed  as  a  percentage  of  the  labour  force. 

Average  Monthly  Salary  for  Those  Employed  Full-time  -  the  arithmetic  average  of  the  monthly  salaries 
reported  by  respondents  to  the  employment  income  question,  who  indicate  employment  on  a  full-time 
basis  (greater  than  30  hours  per  week). 
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Statistical  Adjustment 

Survey  results  are  adjusted,  using  standard  statistical  methods,  to  compensate  for  differences  in 
institutional  survey  populations  and  response  rates.  A  description  of  the  methods  used  is  available  from 
the  AECD  System  Information  branch. 

Survey  Methodology 

1 .  Timing  -  For  "parchment"  programs  and  Preparatory  &  Basic  Upgrading  programming  at 
Colleges  &  Technical  Institutes,  a  follow-up  survey  administered  annually,  six  to  nine  months 
following  date  of  completion  of  program  and/or  requirements  for  graduation.  For  "parchment 
programs"  at  Universities  and  Private  Colleges,  a  follow-up  survey  administered  biennially,  two 
years  following  the  date  of  graduation. 

2.  Reporting  -  data  to  be  submitted  in  the  Fall  of  the  year  following  any  year  in  which  a  survey  has 
been  undertaken.  For  Colleges  and  Technical  Institutes,  data  from  the  survey  of  1995-96  graduates 
will  be  reported  in  for  the  1996-97  reporting  year.  For  Universities  and  Private  Colleges,  the  results 
of  surveys  last  reported  will  be  carried  forward. 

3.  Sampling  -  For  Colleges  &  Technical  Institutes,  full  population  survey  (all  graduates  or 
completers),  to  provide  each  graduate  with  an  opportunity  to  respond.  For  Universities  and  Private 
Colleges,  stratified  random  sampling  across  all  degree,  diploma,  and  certificate  programs  is 
acceptable,  provided  that  samples  are  of  sufficient  size  to  provide  results  for  each  institution  by 
program. 

4.  Survey  instruments  may  vary  from  institution  to  institution,  to  the  extent  that  each  includes 
questions  relevant  for  internal  planning  and  other  purposes.  Surveys  may  be  conducted  by  third 
parties  on  behalf  of  individual  institutions  or  a  number  of  institutions,  as  was  the  case  for 
Universities  for  the  last  reporting  year.  Institutions  are  to  provide  AECD  a  copy  of  survey 
instrument  used  for  any  cycle  of  reporting. 

5.  Data  should  be  reported  in  "numbers"  as  indicated  by  the  "#"  symbol  in  the  formats  above, 
except  for  Labour  Force  Participation  and  Employment  Rates  where  calculated  percentages  are 
called  for. 

6.  Administration  of  the  survey  instrument  by  telephone  is  acceptable,  but  may  require  some 
adjustment  to  the  wording  of  the  questions.  In  making  changes  to  improve  the  flow  of  the 
instrument,  care  should  be  taken  NOT  to  change  the  intent  or  meaning  of  questions. 

7.  If  any  adjustment  to  a  common  question  is  necessary,  all  institution  and  AECD  should  be 
consulted  prior  to  implementation  of  the  change. 

8.  To  maintain  adequate  confidentiality,  employment  and  salary  information  should  not  be  reported 
for  classifications  or  categories  in  which  either  the  total  number  of  graduates  or  the  number  of 
respondents  is  less  than  three. 

9.  Institutions  are  to  make  every  effort  to  obtain  information  first-hand,  directly  from  the  graduate. 
If  employment  information  is  obtained  from  a  parent  or  roommate,  for  example,  then  institutions 
need  to  make  sure  that  these  sources  can  be  checked  and  verified. 

Common  Employment  and  Academic  Outcomes  Questions  for  All  Sectors,  Institutions  and  Programs 
('^Parchment"  and  Preparatory  &  Basic  Upgrading): 

1.  Are  you  currently  ... 

□  Self  employed 

□  Employed 

□  Not  employed  but  looking  for  a  job 

□  Not  employed,  not  looking  for  a  job 

2.  If  you  are  employed,  to  what  extent  is  the  work  related  to  the  program  from  which  you  graduated 

□  Directly  related  □  Somewhat  related       □  Not  related 


KPI  Reporting  Manual  -  November  1997 


Page  59 


Revisions  to  15/12/97 


3.  If  you  are  employed,  is  it  full-time  or  part-time? 

□  full-time  (30+  hours  per  week)n  part-time  (less  than  30  hours  per  week) 


Working  your  usual  hours  what  would  be  your  current  monthly  employment  income  before 
deductions?  (If  paid  by  the  hour,  provide  an  estimate  based  on  your  usual  hours  of  work) 
$  per  month 

4.  Are  you  a  student  now  or  will  you  enroll  soon? 

□  Currently  enroled  full-time 

□  Currently  enroled  part-time 

□  Not  enroled,  but  will  enroll  within  the  next  year 

□  No  immediate  plans  to  enroll 

Note:  For  purposes  other  than  KPI  reporting,  both  the  institutions  and  AECD  may  require  information  about  the 
jobs  that  graduates  hold  and/or  information  about  their  employers'  main  areas  of  business,  industry  or  service. 
Therefore,  it  is  recommended  that  surveys  include  a  question  which  collects  job  tide  and  nature  of  employer's 
activity. 
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DEMAND  and  CAPACITY 


The  purpose  of  this  information  set  is  to  show  the  level  of  demand  for  credit  programs  and  the 
degree  to  which  demand  is  being  met  by  program  opportunities  (capacity).  These  and  various 
other  measures  may  be  used  to  indicate  whether  there  is  sufficient  level  of  demand  for  programs 
and  whether  appropriate  structures  (institutions,  faculties,  departments,  programs)  are  in  place  to 
meet  the  demand. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Qualified  applications  as  %  of  entry  places 

available  X 
Number  of  applications  and  applicants  to  this 

institution  only,  to  this  and  other 

institutions  -  to  this  program  only,  to  this 

and  other  programs  X 
%  of  qualified  applications  not 

accommodated  PBU  only 

%  of  available  course  seats  filled  PBU  only 


Level  of  Reporting:  By  program  for  all  program  types  except  Preparatory  &  Basic  Upgrading 

and  General  Studies. 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD  level. 
Vocational  Colleges  -  at  CIS  Standard  Name  level. 

By  "program  area"  for  Preparatory  &  Basic  Upgrading  -  data  generated 
at  the  course  level  is  to  be  aggregated  to  Program  Area  (Standard  Name). 
(See  Special  Provisions  below.) 


Scope:  Information  required  for  all  program  types  except  General  Studies: 

Preparatory  &  Basic  Upgrading,  Skill  Training,  Trade  Certificate, 
Certificate,  Diploma,  Other  Career  (Post-Certificate),  University 
Transfer,  Applied  Degree,  and  Bachelor  Degree.  [See  Page  16] 
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Data  Elements  &  Reporting  Systems: 


Program 

Application  cutoff  by  quantity  (quantity) 
Application  cutoff  by  date  (date) 
Qualified  applications 
Program  capacity  (entrants) 
Qualified  applications  as  %  of  capacity 

#  of  applicants  this  institution  only  this 
program  only 

#  of  applications  this  institution  only  this 
program  only 

#  of  applicants  this  institution  only  this  and 
other  programs 

#  of  applications  this  institution  only  this  and 
other  programs 

#  of  applicants  this  and  other  institutions 

#  of  applications  this  and  other  institutions 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

For  PBU  programming 


Program  area  (Standard  Name) 

CIS 

Application  cutoff  by  quantity  (quantity) 

KPIRS 

Application  cutoff  by  date  (date) 

KPIRS 

Qualified  applications 

CIS/KPIRS 

Registered  in  program 

KPIRS 

#  of  qualified  applicants  not  accommodated 

%  of  qualified  applicants  not 

KPIRS 

accommodated 

#  of  course  seats  available 

KPIRS 

#  of  course  seats  filled 

KPIRS 

%  of  available  seats  filled 

KPIRS 

KPIRS 

CIS 
KPIRS 
KPIRS 

CIS 

CIS 
KPIRS 

DAD  /  KPIRS 

DAD  /  KPIRS 

DAD  /  KPIRS 

DAD  /  KPIRS 
DAD  /  KPIRS 
DAD  /  KPIRS 


Specifications  and  Protocols: 

Data  on  applications  and  capacity  is  available  from  CIS.  The  department  will  extract  this  information 
and  feed  it  into  KPIRS.  Where  the  institution  has  not  reported  this  data  properly  in  CIS,  the 
responsibility  will  fall  to  the  institution  to  ensure  the  data  is  entered  into  KPIRS.  Institutions  will  enter 
Application  Cutoff  information  through  KPIRS.  CIS  does  not  include  the  course  load  data  needed  to 
provide  the  aggregations  required  for  PBU  data. 

Duplicate  application  data  is  derived  from  the  Alberta  Council  on  Admissions  and  Transfer  (ACAT) 
Duplicate  Application  Detection  project  (DAD)  data.  The  department  will  extract  this  information  from 
the  DAD  database  and  transfer  it  to  the  KPIRS.  Institutions  will  be  able  to  view  the  data  in  KPIRS. 

All  Programs  except  Preparatory  &  Basic  Upgrading  and  General  Studies: 

Qualified  applicant  /  application  -  An  application  by  a  person  who  is  formally  seeking  admission  to  a 
program  at  an  institution  and  who  has  completed  and  submitted  the  required  application  form(s),  has 
paid  the  appropriate  application  fee  where  such  a  fee  is  levied,  and  has  not  been  advised  by  the 
institution  that  he/she  is  not  qualified  for  the  program.  In  some  programs  there  are  no  standards  other 
than  completing  the  application  process.  A  fee  is  relevant  where  an  institution  requires  a  fee  payment 
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from  an  applicant  to  formally  complete  the  application  process  and  be  considered  for  a  place  in  the 
program.  Refer  to  the  CIS  Program  Data  Manual,  November  1997  Update,  in  the  1989  Enrolment 
Reporting  Manual  for  a  description  of  application  data  in  CIS. 

There  is  no  fixed  date  for  the  determination  of  numbers  of  qualified  applications.  All  qualified 
applications  to  a  program  are  to  be  reported  for  the  "major"  intake  to  the  program.  For  the  system,  in 
90%  of  cases  this  is  the  Fall  session.  Where  multiple  intakes  or  year  round  continuous  intake  is  the 
norm,  institutions  are  to  report  for  the  full  academic  year. 

Although  students  may  have  to  apply  for  admission  to  a  specific  major  as  they  enter  second  year  of  a 
diploma  program,  institutions  should  count  only  those  applying  to  enter  the  program,  not  those 
continuing  in  the  program  after  completing  the  first  year. 

Where  institutions  do  not  complete  a  full  evaluation  for  every  application,  the  number  of  "qualified" 
applications  will  be  determined  by  applying  a  ratio  determined  from  the  portion  of  the  total 
application  pool  for  which  sufficient  review  was  performed  to  determine  those  qualified. 

Program  Capacity  -  The  number  of  entry  places  available  in  a  program  to  qualified  applicants  to  that 
program.  This  information  element  is  to  be  institutionally  determined  and  reported  through  CIS  after 
the  admission  process  is  completed.  Where  the  number  of  students  taken  into  the  program  is  less  than 
the  available  capacity,  the  latter  should  be  reported  to  reflect  fairly  the  number  of  entrants  that  the 
institution  was  prepared  to  serve  with  resources  available  for  the  program. 

Likewise,  in  cases  where  the  available  places  in  a  program  are  increased  at  the  time  of  admission  in 
order  to  accommodate  more  of  the  qualified  applicants,  report  the  number  of  places  filled.  In  other 
words,  once  the  dust  has  settled,  the  intake  capacity  to  be  reported  is  the  larger  of  the  planned  intake 
capacity  and  the  #  of  places  actually  filled.  Refer  to  the  CIS  Program  Data  Manual,  November  1997 
Update,  for  more  on  program  capacity. 

A  student  place  available  in  a  program  represents  the  capacity  needed  for  a  full-time  student  to  take 
the  normal  full  load.  In  the  case  of  part-time  students,  the  normal  load  of  a  part-time  student  is  less 
than  a  full  load.  Thus,  if  the  program  accepts  more  than  one  student  into  a  normal  full-time  place,  an 
adjustment  has  to  be  made  in  the  way  capacity  for  the  program  is  expressed  when  reporting  it  in  CIS. 
One  hundred  places  for  full  load  students  might  translate  into  200  or  300  places  if  all  students  are 
part-time.  The  number  of  such  places  needs  to  be  expressed  in  a  way  that  is  consistent  with  the 
number  of  qualified  applicants.  That  is,  if  part-time  places  are  made  available  to  handleSOO  applicants 
for  part-time  study,  the  capacity  of  the  programs  should  not  be  reported  as  100  full  load  places,  but 
converted  to  300  places  for  part-time  students. 

For  programs  with  continuous  intake,  as  noted  above,  the  application  count  covers  all  applications  to 
attend  in  the  academic  year.  The  capacity  is  the  total  intake  that  can  be  obtained  during  the  year. 
Since  the  applications  and  capacity  are  being  reported  to  the  department  after  the  year  is  over,  the 
capacity  need  not  be  determined  until  the  academic  year  is  over  and  all  new  registrations  can  be 
counted.  The  capacity  will  always  be  at  least  as  big  as  the  number  of  places  filled  during  the  year. 

Application  Cutojf  -  The  method  used  to  "cut  off  or  limit  the  number  of  applications  after  which  limit 
applications  are  returned  without  consideration.  May  be  a  date,  a  predetermined  quantity,  a  multiple 
of  the  program  capacity,  etc. 

Data  on  Application  Cutoff  is  to  be  provided  by  institutions  and  entered  into  KPIRS.  This  may 
require  explanation  through  a  note  in  the  notes  section  of  the  KPIRS  screen  for  this  indicator. 

Applications / Applicants  to  "This  Institution  Only"  -  "This  Program  Only"  and  "This  and  Other 
Programs"  -  The  AC  AT  Duplicate  Application  Detection  database  will  be  used  to  identify  for  each 
institution  and  program  those  applicants  who  have  applied  only  to  one  institution.  At  a  "program" 
level  at  the  given  institution,  the  number  of  applications  will  be  equal  to  the  number  of  applicants. 
But  when  ACAT  produces  an  aggregation  of  programs  at  that  institution,  the  number  of  applications  is 
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likely  to  exceed  the  number  of  applicants.  The  program  level  data  in  KPIRS  cannot  itself  be  rolled  up. 
This  must  be  done  by  AC  AT  and  included  in  the  data  transferred  into  KPIRS.  In  order  for  there  to  be 
adequate  data  for  "This  Institution  —This  and  Other  Programs"  from  DAD,  all  applications  should  be 
included  in  the  institutional  DAD  file. 

Applications  / Applicants  to  "This  and  Other  Institutions"  -  At  a  "program"  level  at  the  given  institution, 
the  number  of  applications  will  be  equal  to  the  number  of  applicants  but  in  an  aggregation  of 
programs  in  the  "other  institutions"  count,  the  number  of  applications  is  likely  to  exceed  the  number 
of  applicants. 

Preparatory  &  Basic  Upgrading  Programs 

For  Preparatory  &  Basic  Upgrading  programming,  some  of  the  data  pertains  to  the  program  while  some, 
such  as  the  number  of  course  seats  available,  are  to  be  generated  at  the  course  level  and  aggregated  to 
Program  Area  (Standard  Name)  for  entry  through  KPIRS.  The  following  specialization  of  definitions 
and/or  methods  apply: 

Program  Area  -  The  broad  program  grouping  at  which  course  registrations  are  to  be  summarized  and 
reported  for  PBU  programs.  The  program  area  will  correspond  to  the  CIS  Standard  Name,  such  as 
Adult  Literacy,  ABE,  ESL. 

Qualified  Applications  -  An  application  by  a  person  who  is  formally  seeking  admission  to  a  program  at 
an  institution  and  who  has  completed  and  submitted  the  required  application  form(s),  has  paid  the 
appropriate  application  fee  where  such  a  fee  is  levied,  and  has  not  been  advised  by  the  institution  that 
he/she  is  not  qualified  for  the  program.  This  is  reported  through  CIS  at  the  ProgID  level  and 
aggregated  to  the  Standard  Name  level  for  this  indicator. 

Registered  in  Program  -  The  number  of  qualified  applicants  who  have  registered  in  the  program  and 
remain  enroled  past  the  deadline  for  withdrawal  without  penalty  or  effect.  (These  are  the  "active" 
registrations  reported  in  CIS.) 

#  of  Qualified  Applicants  Not  Accommodated  -  This  number  should  reflect  those  students  wait-listed  or 

not  accepted  by  the  institution  because  seats  were  not  available  for  them  in  the  program,  course,  or 
courses  for  which  they  applied.  This  would  not  include  "No  Shows"  or  early  withdrawals  up  to  the 
date  that  an  institution  allows  students  to  "drop"  all  courses  without  penalty  or  effect. 

#  of  Course  Seats  Available  -  This  number  should  be  the  sum  total  of  course  spaces  (or  seats)  available 

for  students  in  a  program  area  (Standard  Name  level).  This  figure  needs  to  include  spaces  available, 
not  only  for  full  time  upgrading/ESL  students,  but  also  spaces  reserved  for  students  registered  in  and 
counted  as  students  in  post- secondary  programs  but  who  are  taking  upgrading/ESL  on  a  part-time 
basis.  If  class  sizes  are  temporarily  increased  to  accommodate  more  students,  and  no  additional 
resources  are  required  by  the  institution,  these  increased  sizes  will  be  reflected  when  the  number  of 
seats  filled  is  greater  than  the  number  of  seats  available.  If  additional  resources  are  being  used  to 
expand  capacity,  this  should  be  indicated  by  increasing  the  number  of  course  seats  available. 

#  of  Course  Seats  Filled  -  The  sum  total  of  course  spaces  which  are  being  occupied  by  students 

considered  active  in  the  course,  aggregated  to  the  Standard  Name  level. 

Application  Cut-off  -  Once  this  limit  has  been  reached,  applications  are  returned  without  consideration. 
This  limit  may  not  apply  at  institutions  where  students  are  referred  to  the  next  available  intake,  where 
they  are  wait-listed,  or  accommodated  through  acceptance  of  larger  class  sizes,  restructuring  the 
program  or  other  measures,  as  demand  dictates. 
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INSTRUCTIONAL  PROCESS  &  FACULTY  LOAD  INDICATORS 


A  number  of  indicators  provide  information  to  assess  the  instructional  context,  instructional 
loads  of  teaching  units  and  the  average  teaching  loads  of  faculty  members. 

Particularly  for  the  indicators  applying  to  Universities,  the  policy  issues  addressed  include  what 
university  faculty  members  do,  how  their  time  is  distributed  across  primary  university  functions, 
what  instructional  loads  and  student  volumes  are  involved  and  how  these  volumes  relate  to  the 
availability  of  instructional  staff,  particularly  the  availability  of  continuing  academic  staff.  The 
context  for  all  of  these  indicators  is  the  full  set  of  activities  undertaken  by  faculty  members 
within  the  primary  institutional  functions  of  instruction,  research,  community  service,  and  the 
administrative,  internal  service  and  other  supporting  functions  necessary  for  effective 
institutional  operations. 

Measures  of  headcount  enrolment  and  average  class  size  are  included  for  Private  Colleges,  to 
indicate  levels  of  service  and  general  accessibility  to  faculty  and  other  instructional  resources. 


Indicator(s)  Apply  to: 

Student  contact  hours  per  FTE  faculty 
Percentage  of  faculty  time  spent  on 

instruction,  research  and  community 

service 

Total  undergraduate  enrolment  (headcount) 
Total  graduate  enrolment  (headcount) 
Total  course  section  registrations 
Proportion  of  course  section  registrations 

taught  by  continuing  academic  staff 
Section  registrations  per  FTE  teaching  staff 
Average  section  size 


Colleges  &.  Technical 
Institutes 

Universities 

Private  Colleges 

Level  of  Reporting: 


By  Faculty,  Program  Division  or  equivalent  administrative  unit  for 
Colleges  and  Technical  Institutes.  By  Faculty  for  Universities.  At  the 
institutional  level  for  Private  Colleges. 

It  is  recognized  that  no  two  institutions  have  identical  organizational 
structures  and,  therefore,  comparisons  on  these  indicators  should  be 
regarded  as  valid  only  at  the  institutional  level,  or  for  programs  that 
involve  little  "service"  teaching  (cross-program  teaching  and/or  resource 
sharing),  unless  adjustments  have  been  made. 


Scope: 


Information  required  for  all  credit  program  teaching. 
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Data  Elements  &  Reporting  Systems: 


Student  contact  hours  per  FTE  faculty 
Mean  percentage  of  faculty  time  spent  on  - 

instruction 

research 

community  service 
Total  undergraduate  enrolment  (headcount) 
Total  graduate  enrolment  (headcount) 
Total  course  section  registrations 
Continuing  academic  staff 
Proportion  (%)  of  total  course  section 
registrations  taught  by  continuing  academic 
staff 

FTE  teaching  staff 

Course  section  registrations  per  continuing 

academic  staff 

#  of  course  registrations  in  - 

junior  course  lecture  sections 

junior  course  other  sections 

senior  course  lecture  sections 

senior  course  other  sections 
#  of  course  sections  - 

junior  courses  lecture 

junior  courses  other 

senior  courses  lecture 

senior  courses  other 
Average  section  size  - 

junior  courses  lecture 

junior  courses  other 

senior  courses  lecture 

senior  courses  other 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

KPIRS 


XL  templates 
XL  templates 
XL  templates 
XL  templates 
XL  templates 
XL  templates 
XL  templates 


XL  templates 
XL  templates 

XL  templates 


CIS 

KPIRS 
KPIRS 


KPIRS 
KPIRS 

KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 
KPIRS 


Specifications  &  Protocols: 

Student  contact  hours  per  FTE  faculty  (Colleges  and  Technical  Institutes) 

Admin  Unit  [Faculty,  Division  or  Department]  -  Faculty  workload  is  to  be  reported  at  the  first  level 
of  organizational  classification  below  the  "institutional"  level.  The  organizational  aggregation  that  is 
called  "division"  at  one  institution  may  be  called  "department"  or  "faculty"  at  another.  The  analogy  at 
a  university  is  usually  the  "faculty  or  school".  An  equivalent  organizational  aggregate  should  be 
reported  by  colleges  &  technical  institutes. 

Student  Contact  Hours  ( Credit)  -  An  aggregation  of  the  product  of  the  number  of  contact  hours  per 
student  per  week  and  the  number  of  weeks  in  each  session  for  all  students  enroled  in  a  program  or  in  a 
course  or  courses,  over  the  reporting  period.  For  this  indicator  SCHs  are  to  be  aggregated  by 
administrative  unit  of  the  faculty  members  responsible  for  teaching  so  as  to  reflect  the  instructional 
and  teaching  loads  of  the  unit  and  its  associated  faculty. 

Student  Contact  Hour  (SCH)  information  based  on  the  CIS  proxy  calculation  will  be  available  in 
KPIRS  for  institutions  that  wish  to  use  it.  Institutions  may  choose  to  substitute  their  own  calculations 
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for  Actual  SCH  and  enter  the  number  directly  into  a  new  field  in  KPIRS.  A  new  "Administrative 
Unit"  field  has  been  added  to  the  program  classification  structure  of  CIS  so  that  SCHs  and  other  data 
can  be  aggregated  by  the  administrative  unit  responsible  for  instruction.  Institutions  will  need  to 
adjust  this  data  for  "service"  and/or  "cross-divisional"  teaching.  The  institutional  total  SCH  for  all 
Admin  Units  should  reconcile  with  the  total  institutional  SCH  in  the  Access  indicator  information  set. 

Instructional  Faculty  -  Designated  academic  staff  who  teach  credit  courses  and/or  provide  academic 
services  in  support  of  academic,  vocational,  and  technical  instruction  for  credit.  Faculty  service 
officers,  administrative  professional  officers,  professional  librarians,  professional  counselors, 
instructional  assistants,  graduate  assistants,  and  other  academic,  professional  and  administrative  staff 
are  included  to  the  extent  of  their  involvement  in  teaching  or  equivalent  instructional  roles,  for  that 
portion  of  their  duties. 

Full-time  Equivalent  Faculty  -  A  staff  member  carrying  a  normal  full-time  load  for  the  full  term  of  a 
reporting  period  has  a  full-time  equivalence  of  1 .0.  Full-time  equivalence  for  staff  who  are  not  full- 
time  and/or  are  not  engaged  for  the  full  term  of  a  reporting  period  should  be  determined  as  the  product 
of  proportionate  work  load  and  the  proportion  of  the  reporting  period  worked.  For  example,  where  a 
part-time  staff  member  has  carried  a  proportionate  workload  of  0.70  for  half  of  the  reporting  year,  the 
reported  full-time  equivalence  should  be  0.35. 

Re:  "partial  instructional  assignments"  -  instructional  assignments  should  be  pro-rated  in  cases 
where  individuals  do  not  have  full-time  instructional  assignments. 

Re:  "non-traditional  modes  of  delivery"  -  equivalency  estimates  should  be  made  for  involvement 
with  non-traditional  modes  of  delivery. 

Staffing  information  from  institutional  data  sources  should  be  consistent  with  the  information  reported 
to  AECD  through  FIRS  and  for  other  purposes. 

Mean  percentage  time  spent  on  Instruction,  Research,  and  Public  Service  (Universities): 
Alternative  sources  for  this  information  include  reports  currently  prepared  by  faculty  members  and 
submitted  to  department  chairs  or  deans  on  an  annual  basis,  or  an  annual  survey  designed  and 
administered  for  the  specific  purpose  of  generating  this  information. 

The  proportion  of  time  spent  on  administration  and  institutional  service  is  not  to  be  separately  reported. 
Administration  and  institutional  service  includes  activities  that  support  the  University's  outputs  of 
instruction,  research,  and  community  service.  Consequently,  the  time  a  faculty  member  spends  on 
administration  and  institutional  service  is  to  be  allocated  across  each  of  these  outputs  by  the  faculty 
member  in  the  proportion  to  the  time  spent  on  each. 

The  time  spent  on  graduate  student  thesis  supervision  is  to  be  divided  between  instruction  and  research. 
Since  variation  among  faculties  is  expected,  the  division  of  this  time  will  need  to  be  determined  on  a 
Faculty  by  Faculty  basis. 

Instruction  -  All  activities  that  are  part  of  an  institution's  instructional  programming  and  the  delivery 
of  all  courses  including: 

teaching  classes;  leading  seminars;  supervising  laboratories,  studios,  rehearsals, 
and  performances;  supervising  work  experience  and  practical  off  campus  activities 

supervising  independent  study 
-  preparing  and  developing  teaching  materials  and  procedures 

engaging  in  academic  and  professional  development  activities  that  support  or 
enhance  teaching  and  which  are  distinguished  from  supporting  the  production  of  some  specific 
scholarly  output 

preparing  and  grading  assignments  and  examinations 
meeting  with  students  during  office  hours  (to  discuss  class  material,  answer 
questions,  review  progress,  and  advise) 
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serving  as  course  coordinator  for  courses  with  more  than  one  section  or  as 
coordinator  of  laboratory  sections  and  tutorials  (Athabasca  University  only) 

Research  -  All  activities  specifically  organized  to  produce  some  type  of  scholarly  outcome 
including: 

developing  and  submitting  grant  proposals  or  applications  for  research  funding 
creating  new  knowledge  using  research  methods  and  procedures  which  are 
appropriate  to  and  accepted  for  the  discipline 

writing  articles,  books,  plays,  poems,  or  reviews 
painting,  composing  music,  giving  a  recital 

engaging  in  academic  and  professional  development  activities  that  lead  to  or 
support  the  production  of  some  specific  scholarly  output,  including  reading  related  to  one's 
discipline;  attending  professional  meetings;  taking  courses;  engaging  in  discussions  with  faculty 
about  disciplinary  issues;  and  preparing  and  delivering  papers  at  conferences 

-  reviewing  proposals  submitted  to  granting  councils  and  foundations,  and  articles 
and  other  forms  of  scholarly  outputs  submitted  for  publication  and  dissemination. 

These  activities  may  be  either  unfunded  or  be  sponsored  through  a  grant  or  contract  which  is 
administered  and  managed  within  the  University. 

Supervision  of  Graduate  Students  -  Activities  related  to  the  supervision  of  graduate  students: 

-  advising  graduate  students  about  academic  and  personal  matters 

-  supervising  work  of  graduate  students  related  to  theses  and  research  projects. 

Community  Service  -  Professional  activities  that  occur  outside  of  the  University.  May  involve: 
liaising  with  public  and  private  secondary  schools,  provincial  colleges  and 
institutes,  national  and  international  universities,  colleges  and  institutes 

providing  service  to  a  discipline,  holding  office  in  a  professional  organization, 

editing  a  journal 

-  presenting  an  invited  address  or  paper 
providing  service  to  a  university  Senate 

Community  service  also  includes  service  to  the  external  community  related  to 
the  exercise  of  one's  academic  and  professional  expertise.  These  activities  may  involve  consulting; 
adjudications,  arbitrations,  and  commissions;  giving  lectures  or  speeches;  holding  office  in  a  public 
organization. 

Administration  and  Institutional  Service  -  Refers  to  a  broad  category  of  activities  that  support  the 
University's  primary  outputs  of  instruction,  research,  and  community  service.  These  activities  include: 
serving  on  university.  Faculty  and  departmental  councils  and  committees 
performing  administrative  duties  which  are  part  of  the  assigned  workload 
performing  administrative  duties  associated  with  a  formal  administrative  appointment 
(President,  Vice-President,  Associate  Vice-President,  Dean,  Director,  Department  Chair, 
Associate  Department  Chair,  program  coordinator,  course  coordinator). 

Undergraduate  &  Graduate  Enrolment  (Unduplicated  Headcount) 

These  are  the  same  data  as  reported  for  the  Access  indicator,  reported  at  the  Faculty  level  for  universities 
and  at  the  institutional  level  for  private  colleges.  Over  the  course  of  a  reporting  year,  a  number  of 
students  may  enroll  in  more  than  one  program.  Accordingly,  institutional  totals  arrived  at  by  the  simple 
addition  of  program  totals  will  not  agree  with  unduplicated  headcounts  produced  at  these  higher  levels  of 
aggregation.  Where  the  data  is  available,  CIS  will  be  used  to  produce  unduplicated  total  headcounts  at 
the  institutional  level  and  these  will  be  used  in  place  of  totals  produced  by  simply  summing  the  program 
headcounts. 
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Proportion  of  Course  Sections  Taught  by  Continuing  Academic  Staff  &  Section  Registrations  per 
FTE  Academic  Staff  (Universities  and  Private  Colleges): 

The  total  number  of  course  section  registrations  taught  by  continuing  academic  staff  members  divided  by 
the  total  course  section  registrations  for  each  Faculty  (or  the  institution,  if  a  private  college)  will  be  used 
to  obtain  the  proportion  taught  by  continuing  academic  staff:  The  total  course  section  registrations  for 
each  Faculty  (or  the  institution,  if  a  private  college)  divided  by  the  number  of  available  teaching  staff 
(full-time  equivalents)  in  that  year  will  be  used  to  obtain  the  average  number  of  course  registrations  per 
full-time  equivalent  teaching  staff  member.  Each  institution  will  disclose  the  details  of  methods  used  for 
calculating  full-time  equivalents  for  part-time  and/or  short-term  staff  members. 

Course  -  Organized  subject  matter  in  which  instruction  is  offered  within  a  given  period  of  time  and  for 
which  credit  towards  graduation  or  certification  is  given. 

Course  section  -  A  group  of  students  which  meets  together  for  instruction  or  for  which  the  elements  and 
resources  of  instruction  are  organized  and  administered.  Courses  with  a  large  number  of  students  are 
generally  divided  into  two  or  more  sections  which  meet  at  different  times  and/or  different  places.  A 
course  may  have  sections  of  different  types  including  lecture,  seminar,  laboratory,  studio,  independent 
study,  clinical  experience,  practicum,  internship,  field  placement,  work  experience,  research, 
developmental  and/or  design  project. 

Course  section  types  are  organized  into  three  categories:  lectures,  seminars  (instructional  activity 
distinguished  by  relatively  small  registration  and  considerable  group  discussion),  and  laboratories 
(the  remaining  section  types;  instructional  activity  which  requires  special  purpose  equipment  and/or 
involves  independent  student  study  and  observation  of  students  in  a  studio,  clinical  or  field  setting). 

Course  section  registration  -  One  student  registered  in  a  section  of  a  course.  A  student  registered  in  a 
term  or  half-course  is  counted  as  one  registration;  a  student  registered  in  a  full-course  is  counted  as 
two  registrations,  one  for  each  term.  A  student  enroled  in  a  course  with  different  types  of  sections  is 
counted  for  each  of  these  sections  (for  example,  a  student  registered  a  half-course  consisting  of  a 
lecture  and  a  laboratory  is  counted  as  two  registrations,  one  for  the  lecture  and  one  for  the  laboratory). 
The  total  number  of  course  section  registrations  for  a  course  is  the  total  of  the  section  registrations  for 
each  section  across  all  section  types. 

Continuing  Academic  Staff  -  Regular  faculty  members  who  have  tenure  or  probationary  appointments 
which  can  lead  to  tenure  and  who  may  be  employed  full-time  or  part-time,  including  professors, 
associate  professors,  assistant  professors,  and  lecturers.  This  classification  includes  academic 
assistants  with  continuing  appointments  (at  the  University  of  Lethbridge)  but  does  not  include  limited 
term,  sessional,  or  tutorial  instructors  who  have  appointments  with  definite  terms,  or  graduate 
teaching  assistants. 

Teaching  Staff  -  A  measure  of  the  total  staff  available  for  teaching  in  full-time  equivalents,  less  the  full- 
time  equivalents  of  staff  members  on  sabbatical  and  those  with  appointments  to  administrative 
positions.  Teaching  staff  includes  professors,  associate  professors,  assistant  professors,  and  lecturers; 
limited  term,  sessional,  and  tutorial  instructors  and  graduate  teaching  assistants  (in  universities). 


Average  course  section  size  (Private  Colleges): 

Reported  at  the  institutional  level  by  the  private  colleges,  average  section  size  is  calculated  for  lecture 
sections  and  other  (seminar  and  laboratory)  sections  for  junior  (the  level  of  course  usually  associated 
with  first  year  instruction)  courses  and  senior  (all  other)  courses.  The  average  section  size  is  determined 
by  dividing  the  total  number  of  section  registrations  by  the  total  number  of  sections  for  each  combination 
of  course  level  (junior,  senior)  and  section  type  (lecture,  other).  Lecture  sections  carrying  less  than  2 
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credits  in  value  are  omitted  as  are  all  private  study  sections,  including  independent  study  and  private 
music  instruction  courses.  All  labs  and  seminars  are  included  in  'Other'. 
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PROGRAM  COSTS 


Measures  of  the  unit  costs  of  programming  to  indicate  that  resources  are  used  efficiently  over 
time  and  that  costs  of  programs  are  comparable  to  those  of  similar  programs  at  other  institutions 
of  comparable  size,  location  and  function.  The  indicators  deal  with  financial  resource  utilization 
by  measuring  the  average  costs  of  providing  instruction  in  various  programs. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Average  cost  per  FLE  enrolment 

X 

X 

X 

Average  cost  per  student  contact  hour 

X 

Level  of  Reporting:  By  program. 

Colleges  &  Technical  Institutes  -  at  CIS  ProgID  level. 
Vocational  Colleges  -  at  CIS  Standard  Name  level. 
Universities  -  at  CIS  Standard  Name  level,  by  program  length. 
Private  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 


Scope:  Information  required  for  all  credit  program  types:  Preparatory  &  Basic 

Upgrading,  Skill  Training,  Trade  Certificate,  Apprenticeship,  Certificate, 
Diploma,  Other  Career  (Post-Certificate),  University  Transfer,  Applied 
Degree,  Bachelor  Degree,  Masters  Degree,  Ph.D.  and  General  Studies, 
[see  Page  16] 

For  Colleges  and  Technical  Institutes,  and  for  Universities,  data  is  to  be 
generated  and  entered  for  each  program  for  which  FLE  enrolment  is 
reported  for  the  Access  indicators.  Private  Colleges  and  Alberta 
Vocational  Colleges,  which  report  Access  indicator  data  at  the  CIS 
ProgID  level,  are  to  report  at  the  Standard  Name  level  for  this  indicator. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Program 

CIS 

XL  templates 

CIS 

Instructional  costs 

KPIRS 

Service  &  support  costs  &  overheads 

KPIRS 

Total  program  costs 

KPIRS 

XL  templates 

KPIRS 

Research  costs 

XL  templates 

Full-load  equivalent  enrolment 

CIS 

XL  templates 

CIS 

Cost  per  FLE  enrolment 

KPIRS 

XL  templates 

KPIRS 

Student  contact  hours  (credit) 

KPIRS 

Cost  per  student  contact  hour 

KPIRS 
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Specifications  &  Protocols  -  Colleges  &  Technical  Institutes: 

Program,  Full-load  Equivalent  Enrolment  and  Student  Contact  Hours  (Credit)  data  will  be  drawn  from 
the  KPIRS  common  information  area.  Instructional  Costs  and  Service  &  Support  Costs  &  Overheads  are 
to  be  determined  in  accordance  with  the  costing  procedures  set  out  in  the  following  and  entered  through 
KPIRS. 

Costing  procedures  for  Colleges  &  Technical  Institutes : 

The  following  procedures  and  protocols  have  been  agreed  upon  by  a  special  working  group  established 
by  the  Colleges  and  Technical  Institutes  Senior  Business  Officers '  Committee  and  representatives  of 
AECD.  They  provide  a  general  framework  for  cost  accounting  and  cost  allocation  that  can  be  applied 
across  a  relatively  diverse  set  of  institutions  to  produce  program  costs  that  are  sufficiently  comparable 
for  the  purposes  ofKPI  reporting. 

The  framework  and  general  methods  proposed  are  "full  cost"  or  "full  absorption  cost"  methods.  They 
are  "activity  based"  to  the  extent  that  allocations  are  based,  insofar  as  practical  given  the  purposes,  on 
activity  information.  It  is  staged  so  as  to  provide  direct  costs  of  instruction  on  a  student  program  basis, 
prior  to  any  indirect  or  overhead  allocations,  and  then  to  provide  "full"  cost  information.  This  enables 
use  of  information  regarding  direct  cost  differentials  before  it  is  masked  by  indirect  cost  allocations, 
especially  in  situations  where  a  low  direct  cost  activity  makes  extensive  use  of  one  or  more  indirect  cost 
resources. 

The  method  facilitates  reconciliation  to  general  ledger  and/or  financial  statement  totals,  provided  that  the 
common  classification  structure  is  being  followed  and/or  that  departures  from  the  common  classification 
are  recorded  and  disclosed.  This  reconciliation  is  important  and  should  be  performed  at  each  stage  of  the 
process  particularly  where  the  costing  is  not  being  undertaken  with  the  same  level  of  detail  for  all 
functions  and/or  programs. 

In  a  context  where  there  are  significant  differences  in  institutions,  their  program  mandates,  organizational 
structures,  accounting  methods,  financial  systems  and  a  variety  of  other  factors,  a  common  approach  to 
cost  allocation  methods  and  procedures  is  essential.  Key  elements  include  classification  structures, 
definitions,  allocation  procedures  and  the  ordering  of  key  stages  and  steps  of  the  methodology. 
Adherence  to  the  approach  set  out  in  the  following  steps  should  keep  "methodological  variance"  (i.e., 
differences  in  costs  which  might  be  attributed  solely  to  differences  in  methodology)  within  reasonable 
and  practicable  limits. 

The  proposed  general  method  has  the  following  steps: 

1 .  Identify  the  departments,  activity  and  or  cost  centres  (hereinafter  referred  to  as  "cost  centres")  and 
the  student  programs  and  other  cost  objectives  for  which  final  costs  are  to  be  determined.  These 
should  be  in  accordance  with  the  functional  classiflcation  structure  and  definitions  used  for  FIRS 
reporting.  Note  that  program  costs  should  be  determined  for  each  "ProgID"  and  or  any  other  level  of 
aggregation  for  which  enrolment  and  instructional  load  information  is  being  generated  for  the  Access 
indicators. 

2.  Classify  ("crossover"  and/or  reclassify)  direct  expenditures  from  institutional  accounts  to  the 
common  classification  structure  (if  not  already  so  classified).  This  step  should  include  adjusting, 
prorating  or  "splitting"  pooled  or  shared  expense  items,  including  faculty  and  staff  who  hold  "joint" 
appointments  and  teach  in  more  than  one  program  area,  and  those  academic  support  costs  (e.g., 
deans,  directors,  program  heads  or  chairs,  and  associated  costs)  and  any  other  costs  (e.g.,  major 
facilities  or  other  supporting  operations)  that  can  be  attributed  directly  to  a  program  division  or  group 
of  programs.  Adjustments  may  also  include  the  identification  and  distribution  of  costs  bom  by 
academic  units  for  primary  functions  other  than  instruction  (including  the  distribution  of  faculty 
compensation  and  other  expenses  based  either  on  the  results  of  faculty  activity  analysis  or 
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5. 


assignment  data  if  available);  and  adjustments  for  charge  backs,  cost  recoveries,  etc.  Prorations 
and/or  splits  should  be  made  on  some  activity-based  method. 

Develop  an  "instructional  workload  matrix".  This  step  may  not  be  required  for  all  institutions.  In 
some  institutions,  a  substantial  volume  of  instruction  is  delivered  from  a  number  of  instructional 
programs,  departments  or  cost  centres,  to  smdents  in  programs  which  are  not  otherwise  directly 
associated  with  those  centres.  The  technique  represented  by  the  instructional  workload  matrix  is  a 
relatively  efficient  way  to  transfer  the  associated  costs  from  the  delivery  units  to  the  recipient 
programs.  Institutions  which  have  relatively  self  contained  programs  (i.e.,  where  nearly  all  students 
take  nearly  all  of  their  instruction  in  courses  offered  by  the  same  cost  centre),  may  find  it  more 
efficient  to  make  "activity-based"  adjustments,  allocations  and/or  prorations  of  cost  for  the  services 
provided  from  one  program  to  students  in  other  programs,  where  necessary. 

Calculate  direct  unit  costs  for  instruction  from  each  cost  centre  identified  in  the  "instructional 
workload  matrix"  if  a  matrix  has  been  used.  These  are  used  to  transfer  costs  from  cost  centres 
offering  the  instruction  to  student  programs  on  the  basis  of  the  distributions  of  "units"  in  the  matrix, 
resulting  in  accumulations  of  instructional  costs  for  each  student  program  (and  for  each  year  and/or 
level  of  program  as  required). 

Cross-allocate  indirect  services,  support,  and/or  overhead  costs  to  remaining  functions  and  to 
programs  and  other  final  cost  objectives  on  the  following  bases: 


5.1  Institutional  Support 


5.2  Academic  Support 


5.3  Student  Services 


5.4  Facilities  Management, 
Operations  and  Maintenance 


5.5  Amortization 


Allocation  on  the  basis  of  direct  expenditures  after 
transfers  and/or  adjustments  in  Steps  2,  3  and  4. 

Allocate  to  program  clusters  based  on  FLE  enrolment, 
after  allocation  of  costs  specifically  attributable  to 
Continuing  Education  (Non-Credit)  based  on 
unduplicated  headcount;  and  after  adjustments, 
prorations  and/or  "splits"  for  Academic  Administration 
costs  in  Step  2. 
(Details  of  specific  allocations  to  be  disclosed.) 

Allocate  to  program  clusters  based  on  FLE  enrolment, 
after  allocation  of  costs  specifically  attributable  to 
Continuing  Education  (Non-Credit)  based  on 
unduplicated  headcount. 
(Details  of  specific  allocations  to  be  disclosed.) 

Allocate  to  program  clusters  based  on  FLE  enrolment, 
after  allocation  of  costs  attributable  to  specific 
programs  or  program  areas. 
(Details  of  specific  allocations  to  be  disclosed.) 

Allocate  using  same  method  as  Facilities  Management, 
Operations  and  Maintenance,  unless  institution  has  a 
more  specific  method,  in  which  case  the  details  of  the 
method  should  be  disclosed. 


Some  institutions  use  more  specific  and  accurate  activity-based  cost  allocation  procedures  than  the 
general  methods  called  for  in  the  foregoing.  The  use  of  these  more  specific  procedures  in  program 
costing  is  encouraged,  with  disclosure  in  a  brief  note  describing  the  method. 

6.   KPI  Reporting  does  not  call  for  the  inclusion  of  revenues  in  costing  reports  at  a  program  level. 

However,  where  revenues  are  generated  from  the  sale  of  "byproducts"  of  instruction  (e.g.,  the  sale  of 
meat  in  a  meat-cutting  program,  products  of  construction  in  a  house  building  program,  etc.),  an 
amount  not  greater  than  the  lesser  of  the  total  revenue,  or  the  cost  of  materials  consumed  in  creating 
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the  goods  or  services  sold,  may  be  deducted  from  costs.  A  reconciliation  of  aggregate  total  program 
costs  with  total  institutional  expenditures  is  required  as  part  of  the  costing  procedure  and  will  need  to 
include  disclosure  of  the  specific  costs  recovered,  overheads  allocated,  and  the  total  amounts  of 
revenue  involved. 

7.  Ancillary  Enterprise  expenditures  should  be  excluded.  AECD's  policy  is  that  ancillary  services  should 
operate  on  a  full  cost  recovery  basis.  On  the  assumption  that  this  policy  is  being  followed  and  that  fair  and 
reasonable  allocations  of  support  costs  and  overheads,  and  capital  amortization  are  being  made,  ancillary 
services  can  be  excluded  from  the  costing  model.  Amounts  excluded  and  corresponding  revenues  will 
need  to  be  disclosed  in  the  reconcihation  of  aggregate  total  program  costs  with  total  institutional 
expenditures. 

8.  Costs  for  programming  that  does  not  generate  "official"  FLE  for  CIS  reporting  should  be  identified 
on  a  program  by  program  basis,  excluded  and  entered  in  the  reconciliation.  [See  "Reconciliation 
with  Total  Operations  Expenditures"  below.] 

The  Instructional  Costs  and  Service,  Support,  Overhead  Allocations  for  each  program  are  to  be  entered 
through  KPIRS.  The  KPIRS  application  will  already  include  Program,  FLE  Enrolment  and  Student 
Contact  Hours  data  for  each  "ProgID"  or  any  other  level  of  aggregation  for  which  Access  data  is  being 
generated,  and  will  calculate  Total  Program  Cost,  Cost  per  FLE  and  Cost  per  SCH  for  each.  For  this 
application  of  KPIRS  to  work  effectively,  it  is  necessary  that  the  Instructional  Cost  and  Service,  Support 
&  Overhead  Allocations  correspond  with  "programs"  for  which  Access  data  is  reported  on  a  one-to-one 
basis. 


Specifications  &  Protocols  -  Universities: 

Faculty  /  Program  -  Program  costs  are  to  be  reported  for  each  program  for  which  Access  data  is 
provided.  Research  costs  are  to  be  reported  at  the  Faculty  level. 

Total  Program  Costs  -  Are  to  be  determined  through  the  application  of  the  specific  costing  procedures 
set  out  in  the  following.  Total  program  costs  include  allocations  for  university  administration/support 
costs  and  for  public/community  services  activities. 

Research  Costs  -  The  direct  (Faculty)  costs  associated  with  research  and  related  service  and  support 
activities  as  determined  through  application  of  the  specific  procedures  set  out  in  the  following. 
Research  costs  include  allocations  for  and  for  public/community  services  activities,  but  do  not  include 
university- wide  administration/support  costs. 

Costing  procedures  for  Universities: 

The  following  procedures  and  protocols  have  been  agreed  upon  by  the  universities  Fiscal  Management 
KPI  working  group  and  representatives  ofAECD.  They  provide  a  general  framework  for  cost 
accounting  and  cost  allocation  that  can  be  applied  across  relatively  diverse  institutions  to  produce 
program  costs  that  are  sufficiently  comparable  for  the  purposes  of  KPI  reporting. 

To  meet  the  requirements  for  indicators  of  average  annual  costs  of  instructional  programs  per  student  in 
undergraduate  and  graduate  programs,  a  methodology  has  been  developed  which  enables  the 
determination  of  average  costs  per  course,  which  are  used  to  accumulate  the  costs  of  all  courses  taken  by 
all  students  in  each  undergraduate  degree,  master's  and  doctoral  program.  Graduate  supervision  costs 
where  applicable,  and  attributable  proportions  of  administration/support  (i.e.,  non-Faculty)  expenses  and 
public  (community  services)  costs,  are  added. 
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1 .  The  expenses  of  the  University  as  identified  in  its  Financial  Statements  are  divided  among  the 
teaching  Faculties,  Special  Sessions,  and  one  administration/support  category  that  includes  all  other 
operating  accounts. 

2.  Faculty  costs  are  distributed  to  four  activity  categories:  (1)  course  instruction,  (2)  graduate  student 
supervision  in  support  of  the  program,  (3)  research,  and  (4)  public  or  community  service,  each  as 
defined  for  the  Faculty  Workload  indicators.  The  dean  of  the  Faculty  should  identify  this 
distribution  having  considered  the  following: 

•  The  relevance  of  the  "percentage  time  spent"  data  (Faculty  Workload  Indicator)  on  at  least  the 
distribution  of  faculty  salary  and  related  costs.  (Note  that  the  definitions  provided  for  the  Faculty 
Workload  Indicator  should  also  be  used  here.) 

•  The  allocations  to  course  instruction  and  graduate  student  supervision  will  be  reallocated  entirely 
to  the  support  of  student  programs  at  a  later  stage  of  the  process.  Therefore,  for  example,  any 
expenses  related  to  interaction  and  collaboration  with  graduate  students  that  the  faculty  members 
would  deem  to  be  costs  of  the  research  program  of  the  faculty  members,  rather  than  costs  of  the 
graduate  program,  should  be  included  in  the  overall  percentage  for  the  research  program. 

•  The  allocation  to  research  does  not  include  funds  received  through  research  grants  and  contracts. 
It  is  intended  to  reflect  only  the  support  for  the  research  effort  provided  by  the  University's 
operations  budget,  and  takes  into  account  appropriate  portions  of  academic  and  other  staff 
salaries,  supplies,  and  so  on. 

•  The  allocations  to  community  service  will  be  reallocated  to  student  programs  and  to  research  at  a 
later  stage  of  the  process  (see  Step  10). 

•  The  allocation  percentages  for  the  four  activity  categories  should  add  up  to  100%.  Each  Faculty 
should  allocate  its  internal  administration/support  costs  in  keeping  with  the  extent  to  which  they 
relate  to  the  four  activity  categories. 

3.  The  total  costs  associated  with  teaching  in  the  Faculty  are  allocated  to  course  sections  taught  by  the 
Faculty  in  Winter  Session.  The  costs  of  Special  Sessions  (stipends  or  sessional  replacement  costs  of 
instructors)  are  allocated  to  sections  taught  in  the  Spring  and  Summer  Intersession,  May  to  August. 
The  sections  are  assigned  weights  corresponding  to  their  relative  costs. 

4.  The  cost  of  each  course  offered  by  the  Faculty  (or  Special  Sessions)  is  calculated  as  the  summation 
of  the  costs  of  each  section. 

5.  The  cost  of  each  Winter  Session  or  Intersession  course  is  divided  evenly  among  all  the  students 
registered  in  the  course.  Thus,  the  cost  allocated  to  a  student  depends  on  the  number  and  type  of 
sections  of  that  course,  and  the  total  number  of  students  registered  in  the  course,  rather  than  on  the 
sizes  of  the  particular  sections  of  the  course  in  which  the  student  registered.  This  averaging  removes 
the  variations  that  could  occur  from  students  being  registered,  presumably  by  chance,  in  relatively 
larger  or  smaller  sections  of  the  course. 

6.  The  course  costs  attached  to  each  student  are  projected  to  the  actual  programs  of  the  students  as  a 
summation  across  all  courses  taken  by  student.  In  effect,  students  collect  course  costs  from  all 
faculties  from  which  they  take  courses. 

7.  The  graduate  supervision  costs  of  each  Faculty  are  allocated  to  graduate  programs  based  on  weighted 
enrolments  of  full-time  and  part-time  master's  and  doctoral  students. 

8.  The  teaching,  graduate  supervision,  research,  and  public/community  service  costs  of  every  teaching 
Faculty  are  allocated  to  activities  and  eventually  to  programs  by  the  same  method.  The  instruction 
and  graduate  supervision  costs  of  each  student  program  are  increased  by  contributions  from  all 
faculties  that  serve  that  program. 
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9.  The  total  administrating/support  costs  (i.e.,  non-Faculty  expenses)  are  allocated  to  three  activities  by 
overall  proportions  with  the  proportions  disclosed  in  notes  accompanying  reports. 

10.  Public/community  services  costs  are  reallocated  back  to  instruction  (student  programs)  and  research 
on  a  dollar  pro-rata  basis  and  then  across  programs  on  an  FLE  enrolment  basis. 

11.  The  administration/support  costs  attributable  to  instruction  are  allocated  to  student  programs  based 
on  weighted  student  enrolments.  Intersession  enrolments  are  assigned  weights  equal  to  one-half  of 
the  weights  of  corresponding  part-time  Winter  Session  enrolments.  Doctoral  and  Master's  students 
are  weighted  more  heavily  than  undergraduates  for  the  purposes  of  this  allocation,  reflecting  the 
judgment  that  graduate  students  place  a  greater  load  per  capita  on  the  infrastructure  of  the  University 
than  do  undergraduates.  (Alternately,  these  costs  may  have  been  allocated  to  Faculties  at  an  earlier 
stage  of  the  process.) 

12.  The  average  cost  per  student,  per  year  of  each  program  is  calculated  by  dividing  total  program  costs 
by  the  FLE  enrolment  in  the  program.  The  enrolment  data  used  for  these  and  earlier  calculations  will 
be  that  reported  for  the  Access  indicator  and  cost  information  will  need  to  be  provided  for  each 
program  for  which  FLE  enrolment  data  is  provided. 


Specifications  &  Protocols  -  Private  Colleges: 

Program  and  Full-load  Equivalent  Enrolment  data  will  be  drawn  from  the  KPIRS  common  information 
area.  Total  Program  Costs  are  to  be  determined  in  accordance  with  the  costing  procedures  set  out  in  the 
following  and  entered  through  KPIRS. 

Costing  procedures  for  Private  Colleges: 

The  costing  procedures  for  private  colleges  are  adapted  from  those  for  universities,  eliminating  the  steps 
not  required  for  this  institutional  sector. 

1 .  The  expenses  of  the  institution  as  identified  in  its  Financial  Statements  are  divided  among  the 
teaching  units  and  one  administration/support  category  that  includes  all  other  operating  accounts. 

2.  The  total  costs  associated  with  teaching  are  allocated  to  course  sections  taught.  The  course  sections 
are  assigned  weights  corresponding  to  their  relative  costs. 

3.  The  cost  of  each  course  offered  is  calculated  as  the  summation  of  the  costs  of  each  course  section. 

4.  The  cost  of  each  course  is  divided  evenly  among  all  the  students  registered  in  the  course.  Thus,  the 
cost  allocated  to  a  student  depends  on  the  number  and  type  of  sections  of  that  course,  and  the  total 
number  of  students  registered  in  the  course,  rather  than  on  the  sizes  of  the  particular  sections  of  the 
course  in  which  the  student  registered.  This  averaging  removes  the  variations  that  could  occur  from 
students  being  registered,  presumably  by  chance,  in  relatively  larger  or  smaller  sections  of  the  course. 

5.  The  course  costs  attached  to  each  student  are  projected  to  the  actual  programs  of  the  students  as  a 
summation  across  all  courses  taken  by  student.  In  effect,  students  collect  course  costs  from  all 
teaching  units  from  which  they  take  courses. 

6.  The  administration/support  costs  are  allocated  to  student  programs  in  proportion  to  the  direct  costs 
accumulated  for  each  program. 

7.  The  average  cost  per  student,  per  year  of  each  program  is  calculated  by  dividing  total  program  costs 
by  the  FLE  enrolment  in  the  program.  The  enrolment  data  used  for  these  and  earlier  calculations  will 
be  that  reported  for  the  Access  (FLE  Enrolment)  indicator  and  cost  information  will  need  to  be 
provided  for  each  program  for  which  FLE  enrolment  data  is  provided. 
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Reconciliation  with  Total  Operations  Expenditures 

The  following  format  is  to  be  used  to  reconcile  the  institutional  total  of  the  Total  Program  Costs,  with 
Total  Institutional  Expenditures  as  per  te  data  reported  through  FIRS  for  the  corresponding  fiscal  year. 
This  reconciliation  format  includes  information  required  by  AECD  to  determine  that  standing  policies 
with  respect  to  Ancillary  Services  and/or  overheads  allocation  and  recovery  are  being  met,  and  to  ensure 
that  costs  not  greater  than  revenue  amounts  are  being  excluded  where  revenues  are  generated  from 
"byproducts  of  instruction".  Information  on  brokered  programs  is  also  required  to  determine  the  level  of 
expenditure  on  students  officially  reported  by  another  institution.  These  costs,  on  a  program  by  program 
basis,  are  then  associated  with  the  enrolment  that  you  report  in  CIS  as  being  shared  with  the  brokering 
partners.  The  shared  FLE  are  currently  used  by  the  department  for  the  Access  indicator  to  measure 
growth  in  enrolment  from  a  base  year. 


Reconciliation  of  Total  Program  Costs 
with  Total  Expenditures 

Reconciliation 

Overheads,  etc. 
included  in 
amounts 
excluded 

Revenue 
amounts  where 
relevant 

Total  Expenditures  as  per  Financial  Statements 
Less  such  items  as: 

1 

Ancillary  enterprises 

By-products  of  instruction  (colleges  &  technical  institutes) 
Direct  non-sponsored  research  costs  (universities) 
Administrative  /  support  costs  allocated  to  non-sponsored  research 
Non-credit  costs 

Sponsored  research  (universities) 
Special  purpose,  trust  and  endowment 

Brokered  programs  (specify): 

Other  (specify) 

Plus:  Additions,  if  any  (specify) 
Total  Program  Costs 

1  1 

1 
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COST  per  GRADUATE  (Program  Completer) 


The  average  cost  per  graduate  (program  completer)  is  a  measure  of  unit  costs  used  to  indicate 
that  resources  are  used  efficiently  and  that  costs  are  comparable  to  those  for  similar  programs  at 
other  institutions  of  comparable  size,  location  and  function. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Average  cost  per  graduate  (program 

completer) 

X 

X 

X 

Level  of  Reporting:  By  program. 

Colleges  &  Technical  Institutes  -  at  CIS  ProglD  level. 
Vocational  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 
Universities  -  at  CIS  Standard  Name  level,  by  program  length. 
Private  Colleges  -  at  CIS  Standard  Name  level,  by  program  length. 

Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree,  Bachelor  Degree,  Masters  Degree  and  Ph.D. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Program 

CIS 

XL  templates 

CIS 

Number  of  graduates  (program  completers) 

CIS 

XL  templates 

CIS 

Aggregate  costs  for  graduates  (program 

completers) 

KPIRS 

XL  templates 

KPIRS 

Average  cost  per  graduate  (program 

completer) 

KPIRS 

XL  templates 

KPIRS 

Specifications  &  Protocols: 

Number  of  Program  Completers  -  The  total  number  of  students  who  have  been  determined  by  the 
institution  to  have  completed  all  program  requirements  and  to  whom  the  institution  would  therefore 
confer  a  parchment  where  a  parchment  is  offered,  during  the  reporting  year  for  which  a  costing  is 
performed.  Data  for  the  number  of  program  completers  is  reported  through  CIS  by  Colleges  and 
Technical  Institutes  and  Private  Colleges. 

Aggregate  Costs  for  Program  Completers  -  The  total  costs,  including  direct  and  indirect  costs  and 
overheads,  attributable  to  those  students  who  complete  programs  in  a  reporting  year,  taking  into 
account  the  costs  of  all  courses  taken  and  services  provided  to  each  student  over  all  years  of  enrolment 
leading  to  completion  of  the  program,  calculated  in  accordance  with  the  procedures  and  protocols 
described  in  the  following.  These  data  will  be  prepared  by  institutions  and  reported  through  KPIRS. 
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Average  Cost  per  Program  Completer  -  The  Aggregate  Costs  for  Program  Completers  divided  by  the 
Number  of  Program  Completers.  This  will  be  calculated  by  KPIRS. 


Costing  procedures  for  Colleges  &  Technical  Institutes : 

Two  methods  of  calculating  average  costs  per  graduate  (completer)  of  "parchment"  programs  are 
acceptable:  a  "course-based"  method  and  an  "FLE-based"  method. 

Course-based  Method 

This  method  involves  allocating  program  and  overhead  expenditures  down  as  far  as  the  level  of 
individual  courses  in  the  institution's  Calendar.  Costing  procedures  are  similar  to  the  program  costing 
models  already  documented,  but  with  a  "subroutine"  that  calculates  an  average  cost  per  course  registrant 
for  all  courses  in  a  discipline,  or  offered  by  an  instructional  unit,  or  for  groupings  of  courses  (i.e.  first 
year  or  level,  second  year  or  level,  etc.),  or  for  individual  courses  if  desired.  Indirect  or  "overhead"  costs 
are  distributed  to  these  courses  or  groupings  in  a  manner  similar  to  the  program  costing  model.  The 
process  is  repeated  for  each  of  the  years  in  which  the  program  completers  were  taking  courses  (the  1994- 
95  costs  may  be  used  as  proxies  for  prior  year  costs).  The  resulting  "course  level"  costs  are  used  to 
produce  cumulative  costs  based  on  the  registration  records  of  individual  graduates.  This  model  will 
produce  a  reasonably  accurate  aggregation  of  costs  for  all  the  completers  of  a  program,  which  is  then 
divided  by  the  number  of  completers  to  produce  an  average  cost  per  completer.  The  course-based 
method  may  be  a  preferable  alternative  for  institutions  who  have,  or  may  wish  to  build  a  course  cost 
database  for  internal  management  information  purposes. 

FLE-based  Method 

The  FLE-based  method  relies  more  directly  on  the  costing  model  outlined  above  (for  Cost  per  Student, 
Cost  per  SCH)  which  produces  a  Cost  per  FLE  Enrolment  for  each  for  each  program  at  the  CIS  ProgID 
level.  [AVCs  will  initially  be  using  the  Standard  Name  level.]  From  the  CIS  data  base,  FLE  values  are 
produced  for  each  student,  for  each  year  of  the  student's  enrolment  leading  to  completion  of  a  program. 
Accumulating  these  values  over  the  years  produces  a  total  which  can  be  regarded  as  the  student's  degree 
of  cumulative  involvement  at  the  institution.  For  any  KPI  reporting  year,  the  FLEs  generated  by  the  set 
of  completers  in  each  program  are  cumulated  across  all  sessions  and  years  in  which  any  of  the  students  in 
the  completer  group  were  registered.  Applying  the  relevant  unit  costs  (Cost  per  Student)  for  each 
program  and  each  year  will  produce  an  Aggregate  which  should  approximate  that  which  would  have 
resulted  from  the  more  detailed  course-based  method. 

Sample  calculation  using  the  FLE-based  method: 

Student  "A"  graduates  in  the  1994-95  academic  year  from  Agricultural  Technology  and  again  in 
1995-96  from  Computer  Technology. 

FLE  History: 

"A"  started  in  1990  in  the  Business  diploma  program  =  .40  FLE 
In  1991  "A"  switched  over  to  Computer  Technology  =  .30  FLE 
In  1992  "A"  switched  to  Agricultural  Technology  =  .60  FLE 

1993  Agricultural  Tech  =  .60  FLE 

1994  Agricultural  Tech  =  .80  FLE 

1995  Computer  Technology  =  .60  FLE 

Total  FLE  value  in  Agricultural  Tech:  2.0  FLE 
Total  FLE  value  in  Computer  and  Business  =1.3 
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( 

The  1994-95  Cost  per  Student  for  Agricultural  Technology  is  $10,000/FLE  -  multiply  that  number 
by  2.0  to  derive  the  Cost  per  Completer.  In  this  example  then,  the  cumulative  cost  [aggregate  cost] 
for  the  completer  would  be  $10,000  x  2  =  $20,000,  if  the  FLE  in  Business  and  Computer  Technology 
is  not  included.  If  there  was  only  one  graduate,  then  your  average  cost  per  grad  would  be  $20,000. 

Now,  if  student  "A"  returns  to  school  in  1995  to  complete  Computer  Technology,  the  1991  would  be 
combined  with  the  1995  FLE  and  even  the  1990  Business  FLE  might  be  included.  If  the  Cost  per 
Student  in  Computer  Technology  =  $11,000  and  in  Business  $8,000  then  the  1995-96  aggregate  cost 
for  Computer  Technology  [just  one  grad]  would  be  (.90  FLE  x  $1 1,000  =  $9900)  +  (.40  FLE  x 
$8,000  =$3,200)  =  $13,100. 


FLE  Enrolment 

Academic  Year 

ProalD 

Total 

Cost  /  FLE 

Aaareqate  Cost 

1990 

BUS 

0.4 

$  8,000 

$  3,200 

1991 

CT 

0.3 

$  1 1 ,000 

$  3,300 

1992 

AT 

0.6 

$  10,000 

$  6,000 

1993 

AT 

0.6 

$  10,000 

$  6,000 

1994 

AT 

0.8 

$  10,000 

$  8,000 

1995 

CT 

0.6 

$  1 1 ,000 

$  6,600 

Grand  Total 

3.3 

$33,100 

Total  FLE  value  in  BUS 

0.4 

$  8,000 

$  3,200 

Total  FLE  value  in  CT 

0.9 

$  1 1 ,000 

$  9,900 

Total  FLE  value  in  AT 

2.0 

$  10,000 

$  20,000 

Graduates 

Aaareqate  Cost 

Cost  /  Grad 

1995-96  CT 

1 

$  13,100 

$  13,100 

A  few  things  to  note: 

(1)  Use  the  1994-95  Cost  per  Student  as  a  proxy  value  for  earlier  years,  since  these  data  are  not 
likely  to  be  available  for  earlier  years. 

(2)  When  applying  the  FLE  method,  some  judgments  about  how  to  allocate  the  time  spent  by  a 
graduate  in  programs  (ProglDs)  other  than  the  one  from  which  the  student  graduated  are  required.  In 
this  example,  by  excluding  FLEs  in  Business  and  Computer  Technology,  the  institution  regards  the 
students'  time  in  these  programs  as  not  contributing  to  any  of  the  course  requirements  for 
Agricultural  Technology  or  preparing  the  student  for  entering  the  program.  Furthermore,  these 
Computer  and  Business  FLEs  may  be  part  of  another  program  costing,  as  shown  in  the  example. 
FLEs  in  a  previous  program  should  only  be  used  toward  the  costing  of  one  completion.  If  a  student's 
sessional  FLE  in  a  particular  ProgID  is  used  in  a  1994-95  cost  per  grad  calculation,  it  should  NOT  be 
used  again  in  subsequent  years. 

Some  judgment  is  involved  in  deciding  which  part  of  a  student's  history  to  include  in  the  costing  of 
the  student's  parchment  completion  but  THIS  IS  NOT  UNIQUE  TO  THE  FLE-BASED  METHOD. 
Similar  judgment  calls  are  involved  in  using  the  course  based  method:  Which  courses,  if  not  all,  on 
the  student's  transcript  contributed  in  some  way  to  completion  of  the  parchment  program? 

(3)  A  student  may  have  been  registered  in  a  number  of  different  ProglDs  prior  to  completing  a 
program.  For  example,  some  programs  have  separate  ProglDs  for  different  year  2  streams,  others  for 
years  1  and  2  of  the  "program".  There  are  several  other  reasons.  Many  students  change  their  minds 
about  their  fields  of  study.  Also  students  in  UT,  or  general  studies,  or  preparatory  programs  may 
complete  courses  that  eventually  help  them  to  complete  a  parchment  program  at  your  institution.  In 


KPI  Reporting  Manual  -  November  1997 


Page  81 


Revisions  to  15/12/97 


all  such  cases  there  will  be  more  than  one  ProglD  that  contributes  to  the  student's  cumulative  FLE 
and  cost. 

(4)  In  order  to  calculate  cost  per  completer  using  the  FLE  method  you  need  the  historical  FLE 
enrolment  values  for  program  completers.  This  will  assist  you  in  determining  the  cumulative  FLE  of 
each  student  who  completed  a  parchment  program  in  1995-96.  (A  database  of  FLEs  traced  back  to 
1989  for  all  1995  grads  of  parchment  programs  is  available  through  CIS.  You  can  contact  AECD's 
System  Information  branch  to  request  this  information  if  you  have  not  already  received  it  for  1996- 
97.) 

Costing  procedures  for  Universities  and  Private  Colleges: 

Detailed  methodology  for  calculating  the  average  cost  per  graduate  is  under  development.  This 
methodology  will  provide  for  the  calculation  of  average  cost  per  graduate  based  on  the  actual  programs 
of  individual  students  and  the  costs  of  providing  the  courses  that  each  has  taken.  The  following  main 
steps  will  be  involved: 

1.  Calculate  costs  per  course  registration  for  the  period  over  which  the  student(s)  with  the  longest 
"transcript  history"  have  taken  courses.  These  costs  will  be  calculated  in  a  manner  similar  to  that  set 
out  in  steps  1  through  6  of  the  Costing  Procedures  for  Universities  set  out  for  the  Program  Costs 
indicator  (see  Page  74).  Institution- wide  administration/ support  and  public/community  services 
allocations  should  be  made  at  this  stage  of  the  process. 

2.  Identify  "cohorts"  of  graduates  by  program  and  transfer  status.  (Other  "streams"  may  be  identified.) 

3.  Determine  a  cost  per  graduate  based  on  the  transcript  of  each  graduate. 

4.  Average  the  costs  per  graduate  across  a  "cohort"  to  obtain  the  average  cost  per  graduate  for  the 
transfer,  non-transfer  and  other  streams  which  may  have  been  identified. 
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SPACE  UTILIZATION 

The  Space  Utilization  indicator  provides  general  measures  of  the  intensity  of  utilization  of 
classroom  and  class  laboratory  facilities  for  credit  instruction,  non-credit  activities  and 
community  services. 


Indicator(s)  Apply  to: 

Average  classroom  hours  per  week 
Average  class  laboratory  hours  per  week 
Average  classroom  hours  as  %  of  50 
Average  class  laboratory  hours  as  %  of  40 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Not 
currently 
reported 


Level  of  Reporting: 
Scope: 


By  institution  at  the  total  institution  level. 

Information  required  for  credit  and  non-credit  instructional 
programming,  and  community  services  activities. 


Data  Elements  &  Reporting  Systems: 


Average  classroom  hours  per  week 
July  /  August  (Summer) 

Credit  instruction 

Non-credit  instruction 

Community  service 
September  /  April  (Winter) 

Credit  instruction 

Non-credit  instruction 

Community  service 
May  /  June  (Spring) 

Credit  instruction 

Non-credit  instruction 

Community  service 
Average  classroom  hours  per  week  as  %  of  50 
July  /  August  (Summer) 

Credit  instruction 

Non-credit  instruction 
September  /  April  (Winter) 

Credit  instruction 

Non-credit  instruction 
May  /  June  (Spring) 

Credit  instruction 

Non-credit  instruction 
Average  class  laboratory  hours  per  week 
July  /  August  (Summer) 
September  /  April  (Winter) 
May  /  June  (Spring) 
Average  class  lab.  hours  per  week  as  %  of  40 
July  /  August  (Summer) 
September  /  April  (Winter) 
May  /  June  (Spring) 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 


KPIRS 
KPIRS 

KPIRS 
KPIRS 

KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 

KPIRS 
KPIRS 
KPIRS 
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Specifications  &  Protocols: 

Average  Classroom  Hours  per  Week  and  Average  Class  Lab.  Hours  per  Week,  from  institutional  records, 
to  be  entered  through  KPIRS.  ACH  per  Week  as  %  of  50,  and  ACLH  per  Week  as  %  of  40  are 
calculated  by  KPIRS. 

Classrooms  -  Rooms  used  for  classes,  that  are  not  tied  to  a  specific  subject  or  discipline  by  equipment 
in  the  room  or  the  configuration  of  the  room.  Includes  lecture  rooms,  seminar  rooms,  general-purpose 
classrooms  which  may  include  multimedia  and  telecommunication  equipment  used  in  a  specific  area 
of  study,  or  may  be  specially  configured,  if  this  equipment  or  special  configuration  does  not  render  the 
space  unsuitable  for  use  by  other  areas  of  study.  Does  not  include  Conference  Rooms,  Meeting 
Rooms,  Auditoria  (unless  used  primarily  for  scheduled  classes),  or  Class  Laboratories. 

Class  Laboratories  -  Rooms  used  primarily  for  formally  or  regularly  scheduled  classes  that  require 
special  purpose  equipment  or  a  specific  room  configuration,  for  student  participation,  practice  in  a 
subject  of  study.  The  special  equipment  or  configuration  will  usually  limit  or  preclude  use  by  other 
areas  of  study.  Includes  teaching  laboratories,  shops,  machine  or  computer  laboratories,  drafting 
rooms,  band  rooms,  choral  rooms,  group  practice  rooms,  language  labs,  group  studios,  theatre  stage 
areas  and  other  performance  spaces  or  similar  rooms.  Does  not  include  gymnasia,  swimming  pools, 
demonstration  schools,  day  care  facilities,  and  other  Special  Use  facilities,  computer  rooms  in 
libraries  or  rooms  used  primarily  for  study. 

Average  Classroom  Hours  per  Week  -  The  average  number  of  hours  per  week  that  classrooms  are  used 
for  scheduled  instructional  activity  or  institutionally  organized  or  sanctioned  group  activities  related 
to  instruction  or  public/community  service.  Sources  of  data  will  depend  upon  institutional 
organization  and  managerial  structures  for  scheduling  and  use  of  facilities.  The  method  of 
determination  should  enable  the  aggregation  of  hours  of  use  for  all  classrooms  for  all  days  of  all 
weeks  of  the  July/ August  period,  the  September  through  April  period  and  the  May/June  period  of  the 
academic  calendar,  and  the  calculation  of  an  average  number  of  hours  per  week  per  classroom  for 
each  period.  Activities  related  to  public/community  service  should  be  separately  identified. 
Commercial  rentals  of  facilities  should  be  excluded.  "Commercial"  covers  those  rentals  where  the 
relationship  between  the  college  and  the  renter  is  purely  commercial  and  has  no  relationship  to  the 
instructional  or  public  services  mandates  of  the  college. 

Average  Class  Laboratory  Hours  per  Week  -  Procedures  are  similar  to  those  for  classrooms.  Hours  of 
individual  student,  casual  and/or  non-scheduled  use  of  class  laboratories  should  be  included  where  the 
specialized  equipment,  facilities  or  configuration  of  the  lab  is  required  for  the  purposes  of  use  or  the 
users  are  supervised  or  monitored. 

Specialized  spaces  which  cannot  be  used  for  other  purposes  should  be  recorded  as  being  used  for  14 
hours  per  day,  5  days  per  week  (=70  hours/week).  This  provision  is  not  intended  to  cover  ordinary 
laboratories  (e.g.  chemistry,  computer).  It  is  intended  to  provide  for  those  very  rare  situations  in 
which  a  ridiculously  low  usage  rate  would  result  simply  because  the  equipment  is  so  very  specialized 
or  the  accommodations  are  such  that  the  lab  can  be  used  by  only  a  very  few  classes  for  a  very  short 
time. 

ACH  per  Week  as  %  of  50  ( Classrooms) /40  ( Class  Labs)  -  Initial  utilization  levels  of  50  and  40  hours 
per  week  have  been  set  as  benchmarks  for  average  utilization  for  classrooms  and  class  laboratories. 
These  may  need  to  be  adjusted  in  the  future  as  patterns  of  use  and  norms  are  established. 

Example  Calculation: 

Assume  that  a  "small"  college  has  three  classrooms.  Classroom  #1  is  scheduled  for  30  class  hours  per 
week  for  16  weeks  in  each  of  the  Fall  and  Winter  sessions,  with  no  other  use.  Classroom  #2  is  scheduled 
for  35  class  hours  per  week  (16  weeks  in  Fall  and  16  weeks  in  Winter),  and  is  used  for  an  additional  300 
hours  over  the  September  through  April  period  for  a  variety  of  activities  (recorded  somewhere,  we  hope). 
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Classroom  #3  is  scheduled  for  45  class  hours  per  week  over  the  32  weeks  of  the  regular  schedule  and  is 
used  for  an  additional  400  hours. 

What  might  be  termed  "aggregate  classroom  hours"  for  the  three  rooms  over  the  September  through 
April  period  comes  to  4,220.  In  1994-95  there  were  34.57  calendar  weeks  (34  weeks  and  4  days)  from 
September  1  through  April  30.  The  average  number  of  hours  of  use  per  room  per  week  can  be  calculated 
to  be  40.7  by  dividing  the  aggregate  classroom  hours  by  34.57  and  the  result,  in  turn,  by  3. 

To  perform  this  calculation  for  any  period  and  any  number  of  rooms  the  following  data  is  needed: 

-  the  aggregate  number  of  hours  that  all  rooms  are  used 

-  the  total  number  of  rooms 

-  the  number  of  calendar  weeks  in  the  period 

The  latter  are:  July  /  August  1994  -  8.86;  September  /  April  1995  -  34.57;  May  /  June  -  8.71.  (Note  that 
a  365  day  year  has  52.14  weeks!) 

There  will  be  various  ways  of  aggregating  the  number  of  hours  that  classrooms  or  class  laboratories  are 
used,  depending  on  the  scheduling,  booking  and  recording  systems  in  use  at  various  institutions.  A 
"matrix"  will  not  always  be  required  (i.e.,  the  utilization  calculations  may  not  be  needed  for  each  room), 
but  some  method  will  need  to  be  developed  to  arrive  at  the  aggregate  total  hours  of  use  of  all  rooms. 
Where  data  is  not  available  and  estimates  are  made,  the  basis  for  estimating  will  need  to  be  disclosed 
and,  in  the  future,  since  KPI  reporting  will  be  subject  to  some  kind  of  audit  process,  documentation  will 
need  to  be  maintained. 


KPI  Reporting  Manual  -  November  1997 


Page  85 


Revisions  to  15/12/97 


KPI  Reporting  Manual  -  November  1997  Page  86  Revisions  to  1 5/1 2/97 


REVENUE  -  REL4TED  INDICATORS 


The  following  revenue-related  indicators  will  be  reported  at  the  institutional  level: 

•  AECD  grants  per  FLE  enrolment 

•  AECD  grants  as  a  percentage  of  total  operations  revenues 

•  tuition  fees  per  FLE  enrolment 

•  other  revenues  per  FLE  enrolment 

•  enterprise  revenues  as  a  percentage  of  AECD  grants 


Indicator(s)  Apply  to: 

AECD  grants  per  FLE  enrolment 
AECD  grants  as  %  of  total  operations 
revenues 

Tuition  fees  per  FLE  enrolment 
Other  revenues  per  FLE  enrolment 
Enterprise  revenues  as  %  of  AECD  grants 


Colleges  &  Technical 
Institutes 


Universities 


Private  Colleges 


Level  of  Reporting:  By  institution  at  the  total 

institution  level. 

Scope:  All  institutions. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

AECD  grants 

HRS 

FIRS 

FIRS 

Tuition  &  related  fees 

HRS 

FIRS 

FIRS 

Other  revenues 

HRS 

FIRS 

FIRS 

Enterprise  revenues 

HRS 

FIRS 

FIRS 

Total  operations  revenues 

FIRS 

FIRS 

FIRS 

FLE  enrolment 

CIS 

XL  templates 

CIS 

Specifications  &  Protocols: 

Financial  data  for  Expenditure-Related  indicators  are  reported  through  the  Financial  Information  and 
Reporting  System  (FIRS)  using  a  comprehensive  system  of  classifications  and  definitions  which  has  been 
developed  for  all  general  financial  information  reporting  to  Alberta  Advanced  Education  and  Career 
Development.  The  following  functional  classifications  are  used  for  Key  Performance  Indicator  data.  No 
reporting  of  this  data  is  required  in  KPIRS. 

Year  -  For  Colleges  &  Technical  Institutes,  the  CIS  enrolment  data  reporting  year  and  the  fiscal  year 
coincide  (July  through  June).  For  Universities  and  Private  Colleges,  enrolment  data  for  a  May 
through  April  reporting  year  will  be  matched  to  financial  data  for  a  corresponding  April  through 
March  fiscal  year. 
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Total  operations  revenues  -  Total  revenues  for  a  fiscal  year  as  reported  in  the  financial  statements  of 
an  institution,  less  Ancillary  Enterprises,  Sponsored  Research,  and  Special  Purpose  and  Trust 
revenues. 

AECD  grants  -  Includes  unrestricted  grants  from  AECD  which  fund  program  delivery  and 
administration,  and  general  capital  requirements  within  each  institution's  mandate  (General 
Operations  Grants),  grants  provided  through  "envelopes"  established  as  part  of  the  AECD  Funding 
Mechanism  (Envelope  Grants)  and  grants  for  specific  programs  or  purposes  which  may  be  restricted 
and/or  may  involve  special  terms,  conditions,  accounting  and/or  funds  management  requirements 
(Conditional  Grants). 

Tuition  fees  -  Credit  tuition  &  related  fees.  Includes  tuition  revenues  from  students,  or  paid  on 
behalf  of  students,  that  result  from  the  assessment  of  fees  for  instruction  in  credit  programs  and 
courses  and  universal  fees  (library  fees,  computer  services,  materials  and  other  similar  fees  or 
charges)  paid  by  all  students,  not  specific  to  courses,  programs  or  the  extent  of  use  of  a  service  or 
quantity  of  materials  used. 

Other  Revenues  -  Total  operations  revenues  (total  revenues  less  ancillary  enterprises,  sponsored 
research,  and  special  purpose  and  trust  revenues)  less  AECD  grants  less  tuition  fees. 

Enterprise  revenues  -  Total  revenues  less  all  government  grants,  tuition  fees  subject  to  AECD  tuition 
policy,  ancillary  enterprises  revenues,  earned  capital  contributions,  and  sponsored  research  revenues 
(universities).  Includes  all  Contract  Credit  and  Non-credit  revenues  and  all  revenues  in  the  Other 
Revenue  type,  including  Other  Alberta  Sources,  Other  Government  Sources,  Other  Public  Sources, 
Private  Sources,  Gifts  &  Donations,  Investment  Revenues  and  Other  Sources. 

Full-load  equivalent  enrolment  -  Full-load  equivalent  enrolment  as  defined  and  reported  for  the 
Access  indicator  information  set  (through  CIS  where  the  data  is  available).  ¥LE  enrolment  data  will 
be  drawn  from  the  KPIRS  common  information  area. 

The  following  indicators  are  calculated  by  KPIRS: 

AECD  grants  /  total  operations  revenue  -  Total  AECD  grants  expressed  as  a  percentage  of  total 
operations  revenues. 

AECD  grants  per  FLE  enrolment  -  Total  AECD  grants  for  a  fiscal  year  divided  by  the  full-load 
equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Tuition  fees  per  FLE  enrolment  -  Tuition  fee  revenues  for  a  fiscal  year  divided  by  the  full-load 
equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Other  revenues  per  FLE  enrolment  -  Total  operations  revenues  (total  revenues  less  ancillary 
enterprises,  sponsored  research,  and  special  purpose  and  trust  revenues)  less  AECD  grants  less  tuition 
fees  divided  by  the  full-load  equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Enterprise  revenues  as  %  of  AECD  grants  -  Enterprise  revenues  expressed  as  a  percentage  of  total 
grants  from  Alberta  Advanced  Education  and  Career  Development. 
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EXPENDITURE  -  RELATED  INDICATORS 


The  following  expenditure-related  indicators  will  be  reported  at  the  institutional  level: 

•  Instruction  expenditures  as  a  percentage  of  total  operations  expenditures 

•  the  total  of  Academic  Support  and  Student  Services  expenditures  as  a 
percentage  of  total  operations  expenditures 

•  Institutional  support  (administration)  expenditures  as  a  percentage  of  total 
adjusted  expenditures 


Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Instruction  expenditures  as  %  of  total 

operations  expenditures 

X 

X 

X 

Academic  support  and  student  services 

expenditures  as  %  of  total  operations 

expenditures 

X 

X 

X 

Institutional  support  expenditures  as  %  of  total 

adjusted  expenditures 

X 

X 

X 

Level  of  Reporting: 
Scope: 


By  institution  at  the  total  institution  level. 
All  institutions. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Instruction  (&  non-sponsored  research) 

expenditures 

FIRS 

FIRS 

FIRS 

Academic  support  &  student  services 

expenditures 

FIRS 

FIRS 

FIRS 

Total  operations  expenditures 

HRS 

FIRS 

FIRS 

Institutional  support  (administration) 

expenditures 

FIRS 

FIRS 

FIRS 

Total  adjusted  expenditures 

FIRS 

FIRS 

FIRS 
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Specifications  &  Protocols: 

Financial  data  for  Expenditure-Related  indicators  are  reported  through  the  Financial  Information  and 
Reporting  System  (FIRS)  using  a  comprehensive  system  of  classifications  and  definitions  which  has  been 
developed  for  all  general  financial  information  reporting  to  Alberta  Advanced  Education  and  Career 
Development.  The  following  functional  classifications  are  used  for  Key  Performance  Indicator  data.  No 
reporting  of  this  data  is  required  in  KPIRS. 

Year  -  For  Colleges  &  Technical  Institutes,  the  CIS  enrolment  data  reporting  year  and  the  fiscal  year 
coincide  (July  through  June).  For  Universities  and  Private  Colleges,  enrolment  data  for  a  May 
through  April  reporting  year  will  be  matched  to  financial  data  for  a  corresponding  April  through 
March  fiscal  year. 

Total  operations  expenditures  -  Total  expenditures  for  a  fiscal  year  as  reported  in  the  financial 

statements  of  an  institution,  excluding  Ancillary  Enterprises,  Sponsored  Research  (universities  and 
private  colleges),  and  Special  Purpose  and  Trust  expenditures. 

Instruction  expenditures  -  Expenditures  by  and  through  cost  centres  and  budgetary  units  directly  and 
primarily  engaged  in  the  delivery  of  the  institution's  instructional  programs. 

Academic  support  &  student  services  expenditures  (total)  -  Academic  support  includes  expenditures  by 
and  through  cost  centres  and  budgetary  units  that  directly  support  primary  functions;  and  activities 
which  directly  support  academic  functions  such  as  course  and  curriculum  development  activities  and 
academic  personnel  development.  Includes:  Libraries  (central  and  branch),  Museums  and  Galleries, 
Academic  Administration  (deans  and  directors,  departments  heads,  chairs  and  associated  staff  and 
functions).  Course  and  Curriculum  Development  (future  oriented  -  relating  to  more  than  one  faculty 
or  program  division  -  not  current  year  changes),  and  Academic  Personnel  Development.  Student 
services  includes  expenditures  by  or  through  units  that  provide  admissions  and  registry  functions  and 
activities  that  support  the  student  body  or  provide  services  to  individual  students  or  student  groups: 
Student  Service  Administration  (including  activities  that  cut  across  student  services  sub-functions), 
Student  Recruitment,  Admissions  and  Records  (admissions,  registrar  &  related),  Counseling, 
Placement  and  Career  Guidance  (central  student  services,  not  academic  or  program  counseling  at  the 
faculty  or  program  level.  Social  Development  and  Recreation  Financial  Aid  Administration,  and 
Intercollegiate  Athletics. 

Institutional  support  (administration)  expenditures  -  Expenditures  by  and  through  units  which  provide 
executive  management,  public  relations,  alumni  relations,  fund  raising  and  development,  corporate 
insurance  premiums,  general  administrative  services  and  any  other  institution-wide  administrative  services. 
Executive  management  includes  the  board,  president,  vice-presidents  and  associate  vice-presidents, 
corporate  planning  and  support  services  related  to  these  functions.  General  Administrative  Services 
includes  financial,  human  resources,  logistical  corporate  services  not  included  in  Executive  Management. 

Total  adjusted  expenditures  -  Total  expenditures  for  a  fiscal  year  as  reported  in  the  financial  statements 
of  an  institution,  excluding  Ancillary  Enterprises,  but  including  Sponsored  Research  (universities  and 
private  colleges),  and  Special  Purpose  and  Trust  expenditures. 

Notes: 

1 .  Total  Operations  Expenditures  and  its  component  categories  above,  as  defined  in  FIRS,  include 
capital  amortization. 

2.  Costs  such  as  severance  pay  and  early  retirement  incentive  costs  are  included  in  Total  Operations 
Expenditures  as  recorded  in  institutional  financial  statements  and  reported  through  FIRS. 
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RESEARCH  -  Intensity 

This  indicator  measures  the  intensity  of  research  in  relation  to  the  total  sphere  of  institutional 
activities.  The  indicator  is  structured  as  a  research  "intensity"  ratio  relating  revenues  for 
sponsored  research  activities  to  provincial  operating  grant  support.  The  numerator  includes  all 
sponsored  research  revenues  -  provincial  and  federal  government  and  non-profit  and  for-profit 
sectors;  the  denominator  is  the  province's  undifferentiated  contribution  to  all  university 
functions  and  supports  salaries  for  faculty  and  other  staff  members  as  well  as  institutional 
infrastructure  including  facilities,  services,  library,  and  computing  support  for  research. 

Data  will  be  obtained  to  calculate  three  three-year  rolling  averages  for  each  Alberta  university 
(excluding  Athabasca  University),  and  for  "peer  group"  comparisons  with  similar  Canadian 
institutions: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 
McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 
Queen's  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 
Brandon  University 
Brock  University 
Mount  Alhson  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary's  University 
Trent  University 
Wilfred  Laurier  University 
University  of  Winnipeg 

Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Sponsored  research  revenues  as  %  of 
provincial  operating  grants 

X 

(except  Athabasca) 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  University  of  Alberta,  University  of  Calgary  and  University  of 

Lethbridge. 


Data  Elements  &  Reporting  Systems: 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

Sponsored  research  revenues  -  KPIRS 

Total  provincial  operating  grants  -  KPIRS 
Sponsored  research  revenues  as  %  of 

provincial  operating  grants  -  KPIRS 
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Specifications  &  Protocols: 

Total  sponsored  research  revenues  and  provincial  grants  are  reported  by  each  university  (Alberta 
universities  and  peer  group  institutions)  through  Statistics  Canada  and  the  Canadian  Association  of 
University  Business  Officers  (CAUBO)  using  definitions  and  formats  developed  by  the  latter,  and  should 
be  available  locally,  and  from  other  Canadian  universities,  through  CAUBO,  for  peer  group 
comparisons.  Use  of  this  source  for  both  the  Alberta  universities  and  peer  group  institutions  will  ensure 
a  reasonable  level  of  comparability. 

Data  for  the  research  intensity  indicator  is  to  be  reported  through  KPIRS. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
should  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  is  maintained  for  a  five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 

Sponsored  Research  Revenues  -  Total  sponsored  research  revenues  from  federal,  provincial  and 
municipal  sources,  individuals,  profit  and  not-for-profit  organizations,  and  foundations,  including 
grants,  contracts  and  other  types  of  awards.  Normally  these  revenues  are  separate  and  segregated 
from  revenues  which  support  the  general  operations  of  the  university. 

Total  Provincial  Operations  Grants  -  Grants  provided  through  AECD  including  the  general  operations 
grant  which  funds  program  delivery  and  administration,  and  general  capital  requirements  within  each 
institution's  mandate;  grants  provided  through  "envelopes"  established  as  part  of  the  AECD  Funding 
Mechanism;  and  conditional  grants  for  specific  programs  or  purposes  which  may  be  restricted  and/or 
may  involve  special  terms,  conditions,  accounting  and/or  funds  management  requirements. 

Sponsored  Research  /  Provincial  Operations  Grants  -  Total  sponsored  research  revenues  expressed  as  a 
percentage  of  total  provincial  operations  grants. 


Athabasca  University: 

This  indicator  will  not  be  reported  for  Athabasca  University. 
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RESEARCH  -  Publications  and  Other  Creative  Works 


Research  performance  can  be  reflected  by  the  "citation  impact"  of  research  papers  produced  by 
university  faculty  members.  The  degree  to  which  these  papers  contribute  to  and  influence  the 
field  or  fields  to  which  they  apply  is  reflected  by  the  citation  impact  of  these  papers.  The 
citation  impact  indicator  is  expressed  as  the  ratio  of: 

•  number  of  citations  received 

•  number  of  publications  reported 

The  following  data  provide  context  for  this  indicator: 

•  number  of  full-time  academic  staff 

•  number  of  papers  cited 

•  percentage  of  papers  cited 

Data  will  be  obtained  to  calculate  five  five-year  rolling  averages  for  the  University  of  Alberta, 
the  University  of  Calgary  and  the  University  of  Lethbridge,  and  for  "peer  group"  comparisons 
with  similar  Canadian  institutions: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 
McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 
Queen's  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 
Brandon  University 
Brock  University 
Mount  Allison  University 
Mount  St. Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary's  University 
Trent  University 
Wilfred  Laurier  University 
University  of  Winnipeg 

Citation  impact  data  is  not  available  for  Athabasca  University  or  Private  Colleges.  Measures  of 
the  extent  of  authorship  and  editorship  of  books;  the  extent  of  publication  through  refereed 
and/or  peer-reviewed  journals,  non-refereed  publications  or  equivalent  means;  and  the  numbers 
of  conference  presentations  will  be  used  to  indicate  the  annual  output  of  research  and  other 
scholarly  activity  that  is  funded,  facilitated  and/or  otherwise  supported  by  these  institutions. 
Peer-reviewed  publications  by  undergraduate  authors  is  included  as  an  indicator  of  the 
involvement  of  students  in  research  and  scholarly  activity  at  these  institutions. 
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Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Citation  impact  indicator 
Number  of  full-time  academic  staff 
Number  of  papers  cited 
Percentage  of  papers  cited 
Books  authored  or  co-authored 
Books  edited  or  co-edited 
Articles  in  refereed  journals 
Non-refereed  publications 
Conference  presentations 
Peer-reviewed  publications  by 
undergraduate  authors 


X 
X 
X 
X 

Athabasca 
Athabasca 
Athabasca 
Athabasca 
Athabasca 

Athabasca 


Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  University  of  Alberta,  University  of  Calgary  and  University  of 

Lethbridge.  Athabasca  University  and  the  Private  Colleges  report  in  a 
special  format. 


Data  Elements  &  Reporting  Systems: 


Full-time  academic  staff 
Number  of  publications  reported 
Number  of  citations  received 
Citation  impact 
Number  of  papers  cited 
Percentage  of  papers  cited 
Books  authored  or  co-authored 
Books  edited  or  co-edited 
Articles  in  refereed  journals 
Non-refereed  publications 
Conference  presentations 
Peer-reviewed  publications  by 
undergraduate  authors 


Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

XL  templates 

KPIRS 

XL  templates 

KPIRS 

XL  templates 

KPIRS 

XL  templates 

KPIRS 

XL  templates 

KPIRS 

XL  templates 


KPIRS 


Specifications  &  Protocols: 

The  Institute  for  Scientific  Information  (ISI)  produces  a  database  of  summary  publication  and  citation 
statistics  that  reflect  research  performance  in  the  sciences  and  social  sciences  for  Canadian  universities. 
The  database  consists  of  counts  of  publications  and  citations  appearing  in  the  6,000  journals  (4,500  in  the 
sciences  and  1,500  in  the  social  sciences)  indexed  by  ISI  over  the  period.  All  these  journals  are  peer- 
reviewed.  For  purposes  of  the  database  ISI  defines  publications  as  including  articles,  notes,  reviews,  and 
proceedings  papers,  but  not  other  types  of  items  such  as  editorials,  letters,  corrections  and  abstracts  or 
books.  Papers  are  attributed  to  an  institution  if  at  least  one  author's  address  identified  the  institution. 

Three  Alberta  universities  and  their  "peer  group"  institutions  are  among  the  45  Canadian  universities 
included  in  the  database  for  the  years  1981-94,  the  most  recent  release.  The  database  is  in  Microsoft 
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Access  v.1.1  format,  accessible  through  a  graphical  user  interface  specific  to  predetermined  analyses,  or 
through  MS  Access  (or  a  compatible  DBMS)  for  more  detailed  analysis. 

The  University  of  Calgary  currently  subscribes  to  the  ISI  database  and  since  it  has  the  same  "peer  group" 
as  the  University  of  Alberta,  its  reporting  will  be  sufficient  for  both  institutions.  The  University  of 
Lethbridge  should  make  arrangements  to  obtain  data  from  the  University  of  Calgary. 

ISI  has  announced  that  it  will  be  collecting  data  on  the  Humanities,  beginning  in  1996.  This  will  enable 
the  gradual  integration  of  Humanities  data  into  future  statistics. 

Indicator  information  is  maintained  for  a  ten  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  five  five-year  rolling  averages.  Data  from  the  most  recent  ISI  database  (which  may  include 
updates  to  prior  year  data)  are  reported  annually. 

Full-time  academic  staff  -  The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1  of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a  salary  scale 
similar  to  teaching  staff,  appointed  on  a  full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave). 

Number  of  citations  received  -  Total  number  of  citations  received  during  the  time  period. 

Number  of  publications  reported  -  Total  number  of  papers  (articles,  notes,  reviews,  and  proceedings 
papers)  reported  through  the  ISI  database  for  a  university  during  a  given  time  period. 

Citation  impact  -  Total  number  of  citations  received  during  a  given  time  period  per  publication 
reported  during  the  period. 

Number  of  papers  cited  -  Total  number  of  papers  cited  during  the  time  period. 

Percentage  of  papers  cited  -  Total  number  of  papers  cited  during  a  time  period  expressed  as  a 
percentage  of  the  total  number  of  publications  reported  during  the  period. 

Athabasca  University  and  the  Private  Colleges  -  are  not  included  in  the  ISI  database.  These  institutions 
will  report  publications  indicator  data  obtaining  the  necessary  data  from  a  number  of  sources  including 
annual  academic  staff  reports,  faculty  surveys,  and  other  internal  records  and  external  sources. 

These  indicators  combine  highly  disparate  forms  of  research  activity  and  output  into  aggregate  measures 
that  do  not  reflect  the  relative  magnitude  of  activities  or  impacts  of  outputs.  Comparisons  between  and 
among  institutions  may  not  be  valid. 

Indicator  information  is  maintained  for  a  five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  and  updates  to 
prior  year  data  are  reported  annually. 

Number  of  Full-time  Academic  Staff  -  The  number  of  full-time  teaching  staff  as  reported  to  Statistics 
Canada  through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff 
employed  as  of  October  1  of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a 
salary  scale  similar  to  teaching  staff,  appointed  on  a  full-time  basis  whose  term  of  appointment  is  not 
less  than  twelve  months  (including  staff  members  on  leave). 

Books  Authored  /  Co-authored  -  The  total  number  of  scholarly  works  reported  by  faculty  members  in 
the  form  of  books  (including  textbooks),  chapters  in  books,  and  monographs,  authored  or  co-authored 
by  the  faculty  members.  Where  more  than  one  co-author  are  faculty  members  at  the  same  institution, 
the  work  is  counted  for  each  faculty  member. 

Books  Edited  /  Co-edited  -  The  total  number  of  scholarly  works  reported  by  faculty  members  in  the 
form  of  books  (including  textbooks),  chapters  in  books,  and  monographs,  edited  or  co-edited  by  the 
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faculty  members.  Where  more  than  one  co-editor  are  faculty  members  at  the  same  institution,  the 
work  is  counted  for  each  faculty  member. 

Articles  in  Refereed  Journals  -  The  total  number  of  articles  and  papers  in  refereed  journals  or 
conference  proceedings. 

Articles  in  Non-refereed  Publications  -  The  total  number  of  articles,  papers,  abstracts,  reviews, 
translations,  creative  writings,  research  reports,  manuals,  notes,  bibliographies,  concordances, 
newsletters,  scripts/musical  scores,  recordings,  patents/trademarks/industrial  designs,  posters  and 
other  works,  in  non-refereed  publications.  Includes  works  of  art,  professional  musical  performances, 
artistic  productions  and  compositions  performed  for  external  (public)  audiences. 

Peer-Reviewed  Publications  by  Undergraduate  Authors  -  Scholarly  works  in  the  form  of  books  or 
articles  (as  defined  above)  created  by  undergraduate  authors  or  co-authors,  published  through  the 
same  processes  and  media  as  peer-reviewed  scholarly  works  created  by  faculty.  Where  co-authors  are 
students  or  faculty  at  the  same  institution,  the  work  is  counted  for  each  co-author. 
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RESEARCH  -  Council  Success  Rates 

National  granting  councils  use  relatively  similar  criteria  applied  consistently  over  time  to 
adjudicate  national  peer-reviewed  grant  competitions.  In  these  competitions,  a  variety  of  factors 
are  taken  into  account  including  the  quality  and  innovativeness  of  the  proposed  research  and  the 
reputation(s),  professional  contributions,  published  results,  and  past  performance  of  the 
researcher(s).  On  the  assumption  that  faculty  members  undertaking  quality  research  will  fare 
well  in  these  competitions,  two  indicators  have  been  defined  at  the  institutional  level: 

•  the  number  of  grant  awards  in  relation  to  the  number  of  applications  made 
to  these  councils 

•  the  average  dollar  value  of  award  received 


Data  will  be  obtained  for  each  Alberta  University,  and  where  available  for  "peer  group" 
comparisons: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 
McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 
Queen's  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 
Brandon  University 
Brock  University 
Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary's  University 
Trent  University 
Wilfred  Laurier  University 
University  of  Winnipeg 

Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Number  of  awards  /  number  of  applications 

X 

Average  dollar  value  of  award 

X 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  All  universities.  Peer  group  comparisons  will  not  be  made  for 

Athabasca  University. 
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Data  Elements  &  Reporting  Systems: 


Full-time  academic  staff 

Number  of  applications 

Number  of  awards 
Dollar  value  of  awards 
Number  of  awards  /  number  of  applications 
Average  value  of  award 


Colleges  &.  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 
KPIRS 


Specifications  &  Protocols: 

Information  on  grants  awarded  (number  of  applications,  number  of  awards,  dollar  value)  is  available 
from  the  Councils,  both  shortly  after  each  competition  and  in  later  consolidated  versions.  Information  on 
academic  staff  members  is  reported  to  Statistics  Canada  through  the  University  Full-time  Teaching  Staff 
System. 

Because  the  pay-out  and  reporting  practices  of  the  three  councils  vary,  between  councils  and  within  each 
council  over  time,  careful  attention  must  be  given  to  appropriate  calculations  for  establishing  the  average 
annual  dollar  value  of  awards  from  the  three  councils. 

The  indicators  are  calculated  as  a  rolling  average  using  a  base  of  three  years  by  dividing  the  total  number 
of  grants  awarded  by  each  council  over  the  three  most  recent  years  of  available  data  by  the  average 
number  of  eligible  academic  staff  members  during  the  same  time  period.  The  reason  for  the  three-year 
base  is  that  the  Councils  make  multi-year  awards,  usually  for  three  years.  As  a  result,  only  a  portion  of 
the  eligible  community  is  assessed  in  any  given  year.  In  the  case  of  the  SSHRC  there  is  the  additional 
consideration  of  a  low  grant  to  eligible  application  ratio  which  tends  to  produce  significant  variations  in 
the  figures  for  individual  universities  from  year  to  year.  The  three  year  base  will  "smooth"  these  short- 
term  perturbations. 

The  most  current  indicator  should  be  accompanied  by  two  historical  reference  points,  which  would 
provide  information  spanning  five  years.  Nationally  comparative  data  on  grants  should  be  available 
within  a  year  of  the  end  of  the  fiscal  year,  but  since  Statistics  Canada  must  be  relied  upon  for  nationally 
comparable  academic  staff  numbers,  there  will  be  a  two-year  delay. 

This  indicator  is  more  sensitive  to  work  in  the  disciplines  of  engineering,  the  humanities,  medicine,  the 
sciences,  and  the  social  sciences  than  to  the  scholarly  work  carried  out  in  the  fme  arts  or  some  of  the 
professional  faculties.  Nevertheless,  using  appropriate  comparisons,  the  results  are  a  reasonable  proxy 
for  the  whole  of  the  institution.  The  size  of  the  eligible  community  and  resources  available  to  serve  the 
community  varies  significantly  from  council  to  council.  When  making  comparisons,  it  is  important, 
therefore,  to  limit  scope  to  institutions  with  appropriate  patterns  of  faculties  and  schools  so  that  similar 
ranges  of  disciplines  are  represented  in  the  calculations. 

Athabasca  University  and  the  University  of  Lethbridge  will  report  disaggregate  information  for  each 
granting  council.  Other  universities  may  report  information  for  each  council  as  an  option.  Peer  group 
comparisons  will  not  be  made  for  Athabasca  University. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
will  report  the  peer  group  data  on  behalf  of  both. 
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Indicator  information  is  maintained  for  a  five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 

Granting  Council  -  One  of  the  three  national  granting  councils:  Medical  Research  Council  (MRC), 
the  Natural  Science  and  Engineering  Research  Council  (NSERC),  the  Social  Sciences  and  Humanities 
Research  Council  (SSHRC). 

Full-time  academic  staff  -  The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1  of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a  salary  scale 
similar  to  teaching  staff,  appointed  on  a  full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave). 

Number  of  Applications  -  For  the  UofA  and  UofC,  the  aggregate  number  of  applications  to  the  three 
national  granting  councils  in  the  general  category  of  "operating"  or  "research"  grants,  for  research 
programs  carried  out  primarily  by  individuals  or  (much  less  frequently)  by  small  teams  of  faculty 
members.  For  the  UofL  and  AU,  the  number  of  applications  to  each  council.  Specifically,  these 
include  Standard  Research  Grants  for  SSHRC;  Individual,  Team  and  Project  Research  Grants  for 
NSERC  as  well  as  the  Research  Grant  portions  only  of  Women's  Faculty  Awards  and  University 
Research  Fellowships;  and  Operating  and  Program  Grants  for  MRC.  They  exclude  applications  for 
Networks  of  Centres  of  Excellence  (NCE)  grants,  SSHRC  Major  Collaborative  Research  Initiatives, 
MRC  Groups,  or  any  equipment  grants,  infrastructure  support,  stipend  awards,  scholarships  or 
fellowships,  targeted  or  joint-funded  research  projects,  or  other  special  purpose  awards. 

Number  of  Awards  -  The  aggregate  number  of  awards  in  the  same  categories  identified  in  the 
specifications  for  Number  of  Applications. 

Dollar  Value  of  Awards  -  The  aggregate  annual  dollar  value  of  new  grants  awarded  by  the  three 
national  councils  in  the  same  categories  identified  in  the  specifications  for  Number  of  Applications. 

Number  of  Awards  /  Number  of  Applications  -  The  aggregate  number  of  awards  divided  by  the 
aggregate  number  of  applications  and  expressed  as  a  percentage,  in  the  same  categories  identified  in 
the  specifications  for  Number  of  Applications. 

Average  Value  of  Award  -  The  total  dollar  value  of  awards  divided  by  the  aggregate  number  of 
awards,  in  the  same  categories  identified  in  the  specifications  for  Number  of  Applications. 
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RESEARCH  -  Graduate  Students 

Graduate  students  enroled  in  thesis  programs  participate  in  and  contribute  to  the  research 
mandate  of  the  university  and  quality  faculty  members  engaged  in  research  and  scholarship 
attract  students  desiring  research  degrees.  Accordingly,  the  higher  the  proportion  of  thesis  based 
program  graduate  student  enrollees  to  academic  staff,  the  more  research  intensive  and  higher  the 
quality  of  the  academic  staff  and  research  of  the  university.  Unlike  undergraduate  students  who 
are  relatively  less  mobile,  graduate  students  are  more  often  in  a  position  to  move  among 
institutions  and,  having  completed  a  first  degree,  are  more  sensitive  to  the  quality  of  and  will 
seek  places  at  those  institutions  which  have  the  better  post-graduate  offerings. 

At  the  same  time,  prospective  graduate  students  are  attracted  to  institutions  with  higher  levels  of 
financial  support.  There  tend  to  more  scholarships  and  other  financial  support  opportunities  at 
institutions  with  intensive  research  programs  and  where  a  high  priority  is  attached  to  providing 
support  from  internal  sources.  Quality  academic  staff  attract  additional  external  research  funds 
which  provide  paid  research  positions  for  graduate  students  and,  where  needed,  the  resources, 
equipment,  and  other  essentials  needed  for  these  students  to  complete  their  own  research. 

The  following  indicators  deal  with  research  as  it  is  interrelated  with  graduate  instruction  and 
training,  and  the  research  activities  of  graduate  students: 

•  graduate  student  enrolment  in  thesis  (i.e.,  research)  based  programs 
relative  to  the  number  of  full-time  academic  staff. 

•  total  graduate  enrolment  per  full-time  academic  staff. 

•  the  number  of  competitive  national  graduate  scholarships  and  fellowships 
relative  to  the  number  of  full-time  academic  staff. 

For  each  of  these  indicators  and  each  university,  data  will  be  obtained  for  a  number  of  similar 
Canadian  institutions  for  "peer  group"  comparisons: 

Alberta  and  Calgary 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 
McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 
Queen's  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 
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Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Graduate  students  (thesis)  /  full-time 

academic  staff 

X 

Total  graduate  students  /  full-time  academic 

staff 

X 

Number  of  graduate  scholarships  and 
fellowships  /  full-time  academic  staff 


Level  of  Reporting: 
Scope: 


By  institution  at  the  total  university  level. 

The  University  of  Alberta  and  The  University  of  Calgary. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Full-time  academic  staff 

KPIRS 

FLE  graduate  students  (thesis  programs) 

KPIRS 

FLE  graduate  students  (thesis  programs)  / 

full-time  academic  staff 

KPIRS 

Total  graduate  students 

KPIRS 

Total  graduate  students  /  full-time  academic 

staff 

KPIRS 

Number  of  granting  council  graduate 

scholarships  and  fellowships 

KPIRS 

Number  of  graduate  scholarships  and 

fellowshiDS  /  full-time  academic  staff 

KPIRS 

Specifications  &  Protocols: 

The  Canadian  Association  of  Graduate  Schools  (CAGS)  publishes  an  Annual  Statistical  Report  with 
enrolment  data.  Information  about  academic  staff  can  be  obtained  from  Statistics  Canada's  Teachers  in 
Universities.  The  CAGS  report  appears  annually,  usually  in  the  fall  following  the  end  of  the  traditional 
academic  year.  The  Statistics  Canada  report  usually  appears  a  year  later.  The  CAGS  report  is  based  on 
data  supplied  by  the  graduate  schools  using  agreed  definitions. 

Full-time  equivalent  enrolment  is  used  for  indicators  applying  only  to  the  two  Alberta  Universities.  Total 
headcount  (full-time  plus  part-time,  not  weighted)  is  used  for  national  peer  group  comparisons  since  FLE 
data  is  not  available  inter-provincially  on  a  comparative  basis. 

Assuming  performance  indicators  are  to  be  reported  in  the  fall  of  each  year,  the  most  recent  institutional 
data  should  be  used  and  converted  to  nationally  comparable  data  as  soon  as  the  latter  become  available. 
The  most  current  indicator  should  be  accompanied  by  four  historical  reference  points,  the  four 
immediately  preceding  years.  As  nationally  comparative  data  may  not  be  available  for  one  or  two  years 
after  internal  data  are  available,  the  full  report  may  include  one  or  two  years  of  unconverted  data  and 
three  or  four  years  of  converted  data.  As  all  Alberta  universities  offering  graduate  programs  subscribe  to 
the  CAGS  reporting  definitions,  the  conversion  of  internal  to  nationally  comparable  data  should  not 
result  in  significant  differences  from  year  to  year. 
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The  indicators  are  not  directly  indicative  of  the  quality  of  academic  staff  or  research  in  areas  where 
course-based  programs  are  offered.  However,  it  is  not  unusual  for  some  faculties,  particularly  in  the 
professional  areas,  to  offer  both  thesis  and  non-thesis  programs.  In  this  regard,  care  must  be  taken  in 
interpreting  Indicator  4;  it  should  be  expected  to  be  lower  in  these  faculties  than  in  facilities  with  no 
course-based  graduate  programs.  Moreover,  in  the  humanities  and  social  sciences  (the  SSHRC 
disciplines)  the  breadth  of  Ph.D.  offerings  in  these  disciplines  will  have  an  effect.  SSHRC  awards  are  for 
doctoral  study  and  institutions  with  limited  Ph.D.  offerings  in  these  disciplines  will  not  fare  as  well. 

Thus,  at  the  institutional  level,  it  is  important  to  limit  comparisons  to  instimtions  with  similar  patterns  of 
faculties  and  schools.  For  example,  it  would  be  inappropriate  to  compare  universities  with  a  narrow 
range  of  graduate  programs  with  those  which  have  a  nearly  full  complement  of  programs  in  virtually  all 
disciplines.  There  should  also  be  comparability  in  the  levels  at  which  degrees  are  offered,  as  between 
master's  and  doctor's  programs. 

Because  of  their  limited  graduate  enrolments,  these  indicators  are  not  being  reported  by  Athabasca 
University  and  the  University  of  Lethbridge. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
should  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  is  maintained  for  a  five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada,  and  updates  to  prior  year  data,  are  reported  annually. 

Full-time  Academic  Staff  -  The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1  of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a  salary  scale 
similar  to  teaching  staff,  appointed  on  a  full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave).  Reported  for  Alberta  universities  and  national 
peer  group  institutions. 

FLE  Graduate  Students  (Thesis  Programs)  -  Full-load  equivalent  enrolments  including  students  in  a 
qualifying  year  or  as  candidates  for  a  Masters  or  Ph.D.  degree  in  a  program  for  which  the  completion 
of  a  thesis  is  a  requirement  for  the  degree.  Reported  for  Alberta  universities  only. 

FLE  Graduate  Students  (Thesis  Programs)  per  Full-time  Academic  Staff  -  Full-load  equivalent 
graduate  student  enrolment  in  thesis  programs  divided  by  full-time  academic  staff.  Reported  for 
Alberta  universities  only. 

Total  Graduate  Students  -  Total  graduate  enrolment  in  thesis  and  course-based  Masters  and  Ph.D. 
programs,  calculated  as  full-time  students  plus  part-time  students,  not  weighted.  Reported  for  Alberta 
universities  and  national  peer  group  institutions. 

Total  Graduate  Students  per  Full-time  Staff  -  Total  graduate  students  enrolment  in  thesis  and  course- 
based  Masters  and  Ph.D.  programs  (full-time  plus  part-time,  not  weighted)  divided  by  the  number  of 
full-time  academic  staff.  Reported  for  Alberta  institutions  and  national  peer  group  institutions. 

Granting  Council  Graduate  Scholarships  &  Fellowships  -  The  number  of  scholarships  and 
fellowships  awarded  to  graduate  students  through  the  national  council  (MRC,  NSERC  and  SSHRC) 
annual  competitions.  Reported  for  Alberta  universities  and  national  peer  group  institutions. 

#  of  Awards  /  Full-time  Academic  Staff  -  The  number  of  scholarships  and  fellowships  awarded 
divided  by  the  number  of  full-time  academic  staff  members  in  the  corresponding  year.  Reported  for 
Alberta  universities  and  national  peer  group  institutions. 
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RESEARCH  -  Research  Impact 


These  indicators  measure  returns  from  investments  in  research  facilities,  activities  and 
infrastructure  at  Alberta  universities.  Research  funds  from  all  sources  have  an  important 
economic  impact  on  the  local  or  regional  economy,  in  terms  of  employment  and  job  creation  as 
well  as  through  other  types  expenditures  in  the  local  economy.  Five  indicators  are  included: 


•  a  "council  support"  ratio  which  relates  revenues  from  the  three  national 
granting  councils  to  total  sponsored  research  revenues. 

•  "community  and  industry  support"  ratios  which  relate  revenues  for 
research  of  an  applied  nature  supported  by  grants,  contracts  and  contributions 
from  non-government  sources,  to  total  sponsored  research  revenues,  and  to 
full-time  academic  staff. 

•  an  "industry  sponsored  research"  ratio  which  relates  industry  sponsored 
research  support  to  community  and  industry  support. 

•  total  annual  licensing  revenues  to  indicate  both  the  value  of  useful  products 
that  originate  in  university  research  and  the  effort  of  researchers  and 
university-industry  liaison  structures  to  move  these  products  into  industry  and 
society. 

•  disclosures  of  inventions  and  other  commercially  valuable  intellectual 
property. 


For  these  indicators  and  for  each  university,  data  will  be  obtained  for  a  number  of  similar 
Canadian  institutions  for  "peer  group"  comparisons: 


Alberta  and  Calgary 


Lethbridge 


University  of  British  Columbia 


Acadia  University 
Brandon  University 
Brock  University 
Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary's  University 
Trent  University 
Wilfred  Laurier  University 
University  of  Winnipeg 


Dalhousie  University 
University  of  Laval 
McGill  University 


University  of  Manitoba 


McMaster  University 
Memorial  University 


University  of  Montreal 


University  of  Ottawa 
Queen's  University 


University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 
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Indicator(s)  Apply  to: 

Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Council  support  ratio  (council  sources  /  total 

sponsored  research  revenues) 

_ 

UofA,  UofC 

- 

Community  &  industry  sources  /  full-time 

academic  staff 

_ 

X 

_ 

Community  &  industry  sources  /  total 

sponsored  research  revenues 

X 

Industry  sources  /  community  &  industry 

sources 

UofA,  UofC 

Total  licensing  revenues 

UofA,  UofC 

Invention  disclosures 

UofA,  UofC 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  The  University  of  Alberta  and  The  University  of  Calgary  for  all 

indicators.  The  University  of  Lethbridge  for  "community  &  industry 
support"  ratios. 


Data  Elements  &  Reporting  Systems: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Data  reported  through  (or  calculated  by) 

Total  sponsored  research  revenues 

KPIRS 

Support  from  council  sources 

KPIRS 

Council  support  ratio  (council  sources  /  total 

sponsored  research  revenues) 

KPIRS 

Support  from  community  &  industry  sources 

KPIRS 

Community  &  industry  sources  /  total 

sponsored  research  revenues 

KPIRS 

Full-time  academic  staff 

KPIRS 

Community  &  industry  sources  /  full-time 

academic  staff 

KPIRS 

Support  from  industry  sources 

KPIRS 

Industry  sources  /  community  &  industry 

sources 

KPIRS 

Total  licensing  revenues 

KPIRS 

Invention  disclosures 

KPIRS 

Specifications  &  Definitions: 

Research  revenues,  are  reported  by  each  university  (Alberta  universities  and  peer  group  institutions) 
through  Statistics  Canada  and  the  Canadian  Association  of  University  Business  Officers  (CAUBO)  using 
definitions  and  formats  developed  by  the  latter,  and  should  be  available  for  Alberta  and  other  Canadian 
universities,  through  CAUBO,  for  peer  group  comparisons.  For  the  most  recent  year(s),  CAUBO  reports 
(and,  therefore,  peer  comparison  data)  may  not  be  available,  preliminary  Alberta  universities  data  can  be 
obtained  from  the  financial  records  of  each  university. 

These  indicators  are  not  being  reported  by  Athabasca  University. 
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Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
will  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  is  maintained  for  a  five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 

Total  Sponsored  Research  Revenues  -  All  sponsored  research  revenues  from  federal,  provincial,  non- 
profit and  not-for-profit  agencies  including  grants,  contracts  and  other  types  of  awards.  Normally 
these  revenues  are  separate  and  segregated  from  revenues  which  support  the  general  operations  of  the 
university. 

Support  from  Council  Sources  -  The  aggregate  of  grants  received  from  national  granting  councils:  the 
Medical  Research  Council  (MRC),  the  Natural  Science  and  Engineering  Research  Council  (NSERC), 
and  the  Social  Sciences  and  Humanities  Research  Council  (SSHRC).  This  corresponds  to 
"Government  grants  -  Federal"  for  the  three  specified  councils,  in  the  CAUBO  format. 

Council  Support  Ratio  ( Councils  Sources  /  Total  Sponsored  Research  Revenues)  -  Total  grants  and 
awards  from  the  three  national  granting  councils  expressed  as  a  percentage  of  total  sponsored  research 
revenues. 

Support  from  Community  &.  Industry  Sources  -  Bequests,  donations  and  non-government  grants  for 
sponsored  research,  from  individuals,  corporate  commercial  enterprises,  foundations  and  non-profit 
organizations.  This  corresponds  to  "Bequests,  donations,  non-government  grants"  with  the  sub- 
classifications  "Individuals,  Corporate  business  enterprises,  Foundations  and  Non-profit 
organizations"  in  the  CAUBO  format. 

Community  &  Industry  Sources  /  Total  Sponsored  Research  Revenues  -  Total  bequests,  donations  and 
non-government  grants  for  research  purposes  expressed  as  a  percentage  of  the  total  sponsored 
research  revenues. 

Full-time  Academic  Staff  -  The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1  of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a  salary  scale 
similar  to  teaching  staff,  appointed  on  a  full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave).  Reported  for  Alberta  universities  and  national 
peer  group  institutions. 

Support  from  Community  &  Industry  Sources  /  Full-time  Academic  Staff  -  Support  from  Community  & 
Industry  Sources  divided  by  the  number  of  full-time  academic  staff. 

Support  from  Industry  Sources  -  Sponsored  research  revenues  including  grants,  contracts,  awards  and 
other  funding  support  from  corporate  commercial  enterprises  (private  business,  commercial  and 
industrial  organizations  and/or  agencies  acting  on  their  behalf).  This  isolates  the  "corporate  business 
enterprise"  sub-category.  Although  not  published  in  the  CAUBO/Statistics  Canada  reports,  this  data 
will  be  obtained  for  peer  group  comparisons,  if  available,  from  CAUBO. 

Industry  Sources  /  Community  &  Industry  Sources  -  Total  industry  sponsored  research  revenues 

expressed  as  a  percentage  of  total  sponsored  research  revenues  from  community  and  industry  sources. 

Total  Licensing  Revenues  -  Revenues  accruing  from  the  commercial  and/or  industrial  application  and 
development  of  patents,  industrial  designs,  and  other  intellectual  property.  These  data  are  not 
currently  reported  at  a  provincial  or  national  level  but  will  be  obtained  from  reports  published  by  the 
Association  of  University  Technology  Managers,  Inc.  (AUTM)^.  Peer-group  comparisons  will  be 
limited  to  institutions  reporting  through  the  AUTM  surveys. 


^  Association  of  University  Technology  Managers,  Inc.,  49  East  Avenue,  Norwalk,  CT  06851. 
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Invention  Disclosures  -  Disclosures  of  inventions  and  other  commercially  valuable  intellectual  property. 
Not  currently  reported  at  a  provincial  or  national  level  but  will  be  obtained  from  AUTM. 
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RESEARCH  -  Distance  Education 


Athabasca  University  is  developing  a  special  indicator  for  research  relating  to  distance 
education.  Documentation  will  be  included  in  a  future  version  of  this  manual. 
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COMMUNITY  SERVICE  and  ECONOMIC  IMPACT 


The  impact  of  an  educational  institution  on  its  local  economy  can  be  estimates  using  a  model 
which  estimates  the  total  local  income  ("gross  domestic  product")  produced  by  the  institution's 
spending  in  the  local  community,  and  the  total  local  employment  generated. 


Indicator(s)  Apply  to: 

Colleges  &  Technical 

Universities 

Private  Colleges 

Institutes 

Total  local  income  generated 

X 

Total  local  employment  generated 

X 

Reporting  Level: 
Scope: 


By  institution  at  the  total  university  level. 

University  of  Alberta,  University  of  Calgary  and  University  of 
Lethbridge.  Since  Athabasca  University  provides  programs  and  services 
to  students  and  communities  across  the  Province,  it  will  not  report  on 
these  indicators. 


Data  Elements  &  Reporting  Systems: 


Total  local  income  generated 
Total  local  employment  generated 


Colleges  &  Technical 
Institutes 

Universities 

Private  Colleges 

Data  reported  through  (or  calculated  by) 

XL  templates 
XL  templates 


Specifications  &  Protocols: 

Each  institution  will  report  two  data  elements: 

1.  Total  Local  Income  Generated  -  An  estimate  of  the  total  annual  cash  flow  into  an  institution's 
local  economy  arising  from  four  sources:  faculty  and  staff  spending,  university  non-salary  local 
spending,  student  spending  and  visitor  spending,  incremented  by  a  local  "multiplier  effect" 
which  takes  into  account  the  additional  indirect  income  impact  as  each  dollar  spent  moves  from 
one  supplier/consumer  to  the  next  in  the  economy. 

2.  Total  Local  Employment  Generated  -  An  estimate  of  the  total  annual  local  employment 
generated,  expressed  in  PTE  numbers.  The  figure  includes  both  the  direct  employment  created 
within  the  institution  as  well  as  the  indirect  employment  in  the  local  economy  generated  by  the 
"multiplier  effect". 


The  methodology  needed  to  derive  local  economic  impact  figures  requires  many  assumptions  and 
estimates.  To  avoid  giving  the  results  a  false  level  of  precision  the  figures  reported  should  be  rounded 
somewhat.  The  total  local  income  figure  is  rounded  to  the  nearest  $100,000  (e.g.  $  147.6  million),  and 
the  total  local  employment  figure  is  rounded  to  the  nearest  100  PTE  (e.g.  4,700  PTE). 
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Data  Date  of  Record  and  Timing  of  the  Study 

It  is  anticipated  that  KPI  data  will  be  reported  in  January  of  each  year. 

Economic  impact  data  are  derived  for  the  annual  period  coinciding  with  the  universities'  preceding  fiscal 
year,  ending  March  31  for  all  institutions.  In  order  to  derive  student  and  visitor  spending  estimates,  the 
corresponding  "academic  year"  is,  for  purposes  of  this  study,  assumed  to  start  with  the  semester 
beginning  in  May  and  finish  with  the  semester  ending  in  April,  in  order  to  coincide  as  closely  as  possible 
with  the  fiscal  year.  For  example,  data  for  the  1995-96  fiscal  year  was  reported  in  December  1996;  the 
data  included  student  and  visitor  spending  estimates  derived  from  the  Spring  1995,  Summer  1995,  Fall 
1995  and  Winter  1996  semesters. 

Audited  financial  data  for  the  preceding  fiscal  year  are  generally  available  (in  the  form  of  pre-publication 
financial  statements)  in  late  Summer  at  all  institutions,  allowing  the  study  to  be  completed  in  time  for  the 
January  reporting  deadline. 

Conceptual  Model  of  Economic  Impact  on  the  Local  Economy 

The  economic  impact  model  used  is  generally  described  as  a  short  term,  cash  flow  model.  It 
encompasses  an  analysis  of  an  institution's  annual  direct  expenditures  on  local  goods  and  services,  and 
the  local  spending  of  its  faculty  and  staff,  its  students  and  its  visitors.  The  employment  impact  of  the 
institution  is  also  part  of  the  study. 

The  total  annual  direct  spending  is  incremented  by  a  local  multiplier  which  takes  into  account  the 
additional  indirect  business  volume  generated  as  a  result  of  the  direct  spending  of  the  school,  its 
employees,  students  and  visitors.  Direct  employment  is  incremented  by  an  employment  multiplier. 

The  local  community  is  defined  as  each  university's  immediate  metropolitan  area  and  any  surrounding 
"bedroom  communities"  in  which  the  institution's  employees  live. 

Institutional  Spending  Defined 

The  study  results  include  the  expenditure  and  employment  data  derived  from  operating  and  capital 
budget  accounts  as  well  as  sponsored  research  and  other  trust  money  accounts. 

A  number  of  affiliated,  non-institutional  agencies,  organizations  and  businesses  exist  on  every  campus. 
While  some  of  these  are  research  institutes  funded  under  the  auspices  of  departments  and  faculties  or 
funded  from  sponsored  research  grants,  others  are  separate  non-profit  agencies  funded  from  various  non- 
institutional  sources.  Student  unions  are  examples  of  the  latter  group.  In  principle  the  economic  and 
employment  impacts  of  these  groups  should  be  included  in  the  study  as  they  owe  their  existence  to  the 
presence  of  the  university  and  have  a  local  economic  impact.  However,  it  was  decided  that  issues  of  data 
availability,  confidentiality  and  inter-institutional  comparability  likely  preclude  the  inclusion  of  these 
groups'  impacts  in  the  study.  Accordingly,  the  study  is  confined  to  the  institutional  expenditures  (and 
related  employment)  documented  in  the  institution's  financial  data  bases  and  reported  in  its  annual 
financial  statements. 

As  an  exception  to  the  last  statement,  however,  the  expenditures  of  certain  ancillary  units  are  excluded 
from  the  study.  In  general,  the  units  in  question  are  those  selling  goods  and  services  to  students,  staff  and 
faculty,  such  as  the  Bookstore,  Microcomputer  Store,  Student  Housing,  Food  Services,  Campus 
Recreation,  Parking,  etc.  The  main  rationale  for  excluding  these  units  is  that  including  their  economic 
activity  would  yield  a  certain  amount  of  double  counting  of  cash  flow  into  the  local  economy  since 
student,  faculty  and  staff  expenditures  are  captured  elsewhere  in  the  analysis.  Excluding  the  units' 
expenditures  from  the  study  resolves  the  double  counting  problem.  In  addition,  because  institutions 
expect  these  units  to  fully  recover  their  costs  from  sales,  and  so,  in  a  sense,  treat  the  units  as  separate 
business  entities,  there  is  a  philosophical  consistency  in  excluding  their  activities  from  the  study  (i.e., 
they  are  treated  like  other  campus  business  enterprises). 
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Faculty  and  Staff  Spending  in  the  Local  Community 

It  is  assumed  that  faculty  and  staff  local  spending  is  identical  to  net  disposable  income.  Net  disposable 
income  is  assumed  to  equal  net  "take  home"  salaries  and  wages.  The  following  general  approach  may  be 
used  to  calculate  this  amount. 

1.  The  amount  of  total  gross  salaries  paid  to  faculty  and  staff  is  determined.  This  amount  is 
generally  available  in  institutional  financial  statements,  and  should  comprise  the  salaries  paid 
from  operating  as  well  as  sponsored  research  and  other  trust  accounts. 

2.  Payroll  records  are  used  to  determine  total  annual  amounts  deducted  for  non-discretionary  items 
such  as  pension  contributions  (including  Canada  Pension  Plan),  unemployment  insurance, 
income  taxes,  etc.  However,  amounts  for  discretionary  items,  such  as  United  Way  contributions 
or  fees  for  parking,  recreation,  and  faculty  clubs,  etc.,  are  not  included  in  this  total.  The  analysis 
should  include  payroll  records  for  salaries  and  wages  paid  from  operating  funds  as  well  as 
records  for  salaries  paid  from  sponsored  research  and  other  funds  held  in  trust. 

3.  From  the  original  gross  salaries  figure,  an  amount  is  subtracted  equivalent  to  the  total  salaries 
paid  to  staff  in  the  ancillary  units  as  well  as  the  total  salaries  paid  to  students.  Institutional 
expenditure  summaries  that  are  more  detailed  than  the  financial  statements  may  be  needed  to 
derive  these  amounts. 

4.  The  non-discretionary  deductions  data  from  step  2  and  the  gross  salaries  figure  resulting  from 
step  3  are  used  to  calculate  the  faculty  and  staff  local  spending  figure.  The  basic  method  for  this 
calculation  is  to  subtract  the  deductions  figure  from  the  gross  salaries  figure,  however,  some 
adjustments  may  be  necessary  to  account  for  the  student  and  ancillary  staff  salaries  and  their 
attendant  deductions. 

The  main  rationale  for  excluding  non-discretionary  deductions  is  that  they  are  primarily  leakages  from 
the  local  economy.  There  is  no  way  of  determining  when  or  if  the  money  is  spent  in  the  local  economy. 
However,  it  should  be  noted  that  three  types  of  non-discretionary  payroll  deductions  were  viewed  by  the 
committee  not  to  be  leakages,  and  hence  should  not  be  subtracted  from  the  total  gross  salaries  figure. 
The  three  types  are  Alberta  Health  Care  premiums,  dental  plan  premiums  and  extended  health  care 
premiums.  It  was  felt  that  money  deducted  for  health  and  dental  premiums  rolls  back  into  the  local 
economy  continuously  in  the  form  of  payments  to  dentists,  dental  labs,  hospitals,  doctors  and  other  health 
care  practitioners. 

Salaries  of  faculty  on  leave  are  not  deducted  or  discounted  in  any  way  because  it  is  not  possible  to 
determine  what  proportion  of  the  salaries,  on  average,  is  spent  outside  of  the  local  region. 

In  determining  faculty  and  staff  local  expenditures  the  economic  impact  study  literature  often  suggests 
that  an  amount  for  estimated  savings  should  be  deducted  from  net  disposable  income  figures.  It  was 
decided  to  ignore  this  issue  because  determination  of  reasonable  savings  rates  is  problematical. 
Furthermore,  it  is  possible  that,  even  in  the  short  term,  savings  are  put  to  work  in  the  local  economy. 

University  Direct  Expenditures  on  Local  Goods  and  Services 

The  method  of  deriving  the  amount  of  university  direct  expenditures  on  local  goods  and  services  can  only 
be  outlined  here,  as  each  university's  financial  systems  and  volume  of  transactions  are  unique.  First,  the 
non-salary  goods  and  services  expenditures  of  the  university  must  be  derived  from  operating,  capital, 
sponsored  research  and  other  trust  fund  accounts.  Second,  the  amount  or  proportion  spent  locally  must 
be  determined. 

Fringe  benefit  expenditures  made  by  the  institution  are  excluded  from  the  study.  Most  of  these 
expenditures  are  viewed  as  short  term  leakages  from  the  local  economy.  Although  benefits  may  flow 
back  to  the  local  economy  at  some  point  in  time,  the  dollar  value  of  those  returns  cannot  be  determined  in 
the  short  term.  However,  there  are  three  exceptions  to  the  rule  that  fringe  benefits  are  excluded: 
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employer  paid  premiums  for  Alberta  Health  Care,  extended  health  care  and  dental  plans  are  included. 
The  reason  for  this  exception,  as  noted  in  the  previous  section  dealing  with  faculty  and  staff  spending,  is 
that  these  premiums  are  not  viewed  as  short  term  leakages. 

Methods  used  by  the  institutions  to  estimate  local  expenditures  may  range  from  qualitative  approaches, 
involving  the  expert  opinion  of  purchasing,  financial  services  or  materials  management  staff,  to 
quantitative  approaches  (both  manual  and  computer  assisted)  which  query  accounts  payable  data  bases 
and  attempt  to  derive  local  expenditures  using  supplier  postal  codes  or  telephone  numbers  as  local 
criteria.  It  is  recognized  that  supplier  postal  codes  may  be  unreliable  indicators  of  local  suppliers  since 
some  firms  distribute  goods  or  services  from  a  non-local  site  yet  have  a  local  office  for  invoicing 
purposes;  conversely,  other  firms  may  provide  goods  or  services  from  a  local  site  yet  invoice  from  a  non- 
local head  office.  Some  institutions  may  use  quantitative  approaches  as  initial  screening  devices  and 
then  temper  the  results  using  the  knowledge  and  judgment  of  the  expert  staff  mentioned  above. 

Student  Expenditures 

For  purposes  of  estimating  student  expenditures,  official  student  counts  are  compiled  for  each  semester, 
including  spring  and  summer  semesters.  By  agreement,  part  time  students  are  included  in  the  derivation 
of  FLE  student  numbers  at  a  rate  of  50%;  i.e.,  FLE  student  counts  for  a  given  semester  are  calculated  as 
100%  of  the  full  time  student  headcount  plus  50%  of  the  part  time  headcount.  Discounting  part  time 
students  in  this  manner  results  in  a  more  conservative  estimate  of  student  spending. 

Student  expenditures  are  based  on  Alberta  Students  Finance  Board  (ASFB)  estimates  of  individual 
monthly  student  budgets  for  the  year  in  question.  Each  year,  the  ASFB  provides  separate  budgets  that 
vary  according  to  whether  students  are: 

1 .  single  and  living  with  parents,  or 

2.  single  and  living  away  from  home,  or 

3.  married. 

The  universities  differ  from  one  another  in  the  age  and  marital  status  mix  of  their  students  and  in  the 
relative  mix  of  commuters  and  residential  students.  Thus,  each  institution  must  determine  estimates  of 
the  proportions  of  students  in  each  of  the  three  ASFB  categories.  These  estimates  may  be  derived  from 
several  sources:  student  information  systems,  recent  student  surveys,  or  estimates  by  university 
personnel.  The  ASFB  also  provides  a  monthly  budget  estimate  for  single  parent  families.  Because  the 
Alberta  universities  do  not  have  reliable  estimates  of  numbers  of  single  parent  students  this  student 
category  is  ignored. 

The  following  method  of  calculating  estimated  student  expenditures  may  be  used: 

1.  Determine  the  number  of  student-months  in  each  semester  by  multiplying  each  semester's  FLE 
student  count  by  the  number  of  months  in  the  semester. 

2.  Sum  the  numbers  of  semester  student-months  to  arrive  at  an  annual  number  of  student-months. 

3.  Determine  the  pro  rata  numbers  of  student-months  in  each  of  the  three  ASFB  categories  by 
multiplying  the  annual  number  of  student-months  by  the  estimated  institutional  proportions. 

4.  Multiply  the  pro  rata  numbers  for  each  category  by  the  corresponding  ASFB  monthly  student 
budgets  to  yield  total  annual  student  expenditures  in  each  of  the  three  categories. 

5.  Sum  the  resulting  student  expenditures  to  yield  total  annual  student  expenditures. 
Visitor  Expenditures 

It  is  difficult  to  collect  data  concerning  the  number  of  local  area  visitors  who  visit  for  a  university  related 
purpose  and  data  concerning  the  duration  of  their  stay.  The  collection  of  data  that  are  complete, 
accurate,  consistent  from  year  to  year  and  comparable  among  institutions  is  problematic.  The  results  of 
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most  university  economic  impact  studies  indicate  that  visitor  spending  is  a  relatively  small  proportion  of 
total  spending  in  the  local  economy.  Extraordinary  efforts  to  collect  such  data  likely  yield  diminishing 
returns. 

Each  institution  will  collect  data  considered  by  the  institution  to  be  reliable  and  accurate.  These  data 
may  include,  for  example,  numbers  of  out-of-town  conference  delegates  who  attended  university 
sponsored  conferences  and  the  duration  of  those  conferences.  These  data  perhaps  can  be  provided  by  a 
campus  conference  office.  As  a  further  example,  the  athletics  department  may  be  able  to  provide  annual 
numbers  of  visitors  who  are  members  of  varsity  athletic  teams. 

Visitor  expenditures  are  calculated  by  multiplying  numbers  of  visitor-days  by  estimated  per  diem 
expenditures.  Each  university  will  develop  its  own  set  of  per  diem  expenditures,  taking  into  account 
local  factors  and  prices.  As  a  starting  point,  estimated  per  diem  expenditures  for  conference  attendees 
are  usually  available  from  the  local  convention  and  visitors  bureau.  However,  convention  bureau 
estimates  may  need  to  be  tempered  and  adjusted  to  reflect  the  spending  patterns  of  various  types  of 
university  visitors.  If  the  university  has  per  diem  food  and  lodging  allowances  for  its  own  faculty,  staff 
and  varsity  athletic  team  members  these  might  be  used  to  temper  the  convention  bureau  estimates. 

Direct  Employment 

Employment  data  will  include  faculty  and  staff  funded  from  operating  funds  as  well  as  sponsored 
research,  endowment  and  other  trust  funds.  Official  institutional  full-time  equivalent  counts  should  be 
used.  These  counts  are  generally  taken  at  a  point  in  time  (e.g.  December  31),  and  may,  as  a  result, 
exclude  certain  seasonal  staff.  Numbers  of  faculty  on  leave  are  included.  Numbers  of  students  employed 
by  the  institution  are  included.  Numbers  of  staff  employed  in  the  ancillary  units  are  included. 

Income  and  Employment  Multipliers 

Alberta  universities  have  agreed  to  use  the  following  multipliers  for  economic  impact  studies: 
Income  Multipliers: 

Athabasca  University  1.2 
University  of  Alberta  1.7 
University  of  Calgary  1.7 
University  of  Lethbridge  1.5 
Employment  Multipliers: 

All  universities  1.5 

These  multiplier  values  are  based  on  a  survey  of  the  literature  concerning  university  and  other  industry 
economic  impact  studies.  The  survey  indicated  the  above  values  are  conservative  multipliers  for 
municipalities  of  a  similar  size.  Alberta  economic  data  are  not  available  to  support  a  numerical 
computation  of  the  multipliers. 

The  total  direct  annual  cash  flow  into  the  local  economy  is  derived  by  summing  the  cash  flow  arising 
from  the  four  sources:  faculty  and  staff  spending,  university  non-salary  local  spending,  student  spending 
and  visitor  spending.  Total  local  income  is  then  calculated  by  multiplying  the  total  direct  cash  flow  by 
the  value  of  the  multiplier.  Similarly,  total  local  employment  is  calculated  by  multiplying  direct 
employment  by  the  value  of  the  employment  multiplier. 
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Non-Credit  Key  Performance  Indicators:  Final  Report 


1.0  Introduction 

This  is  the  final  report  on  the  consultation  designed  to  develop  a  reporting  structure  that  both  reflects  the 
diversity  of  non-credit  programming  in  the  province's  public  post-secondary  institutions  and  ensures  the 
collection  of  valid,  reliable  and  comparable  data.  This  document  presents: 

•  the  final  recommendations  for  a  reporting  structure  and  the  definitions  required  to  report  within  this 
framework;  and 

•  a  proposed  timeline  for  implementing  this  new  structure. 


1.1  Background 

Extensive  public  consultation  has  revealed  that  Albertans  want  an  accessible,  responsive,  affordable 
learning  system  that  is  accountable  for  its  results.  In  order  to  demonstrate  institutional  accountability,  the 
department  and  the  public  post-secondary  institutions  have  been  working  together  to  develop  Key 
Performance  Indicators  (KPIs)  that  measure  institutional  success  in  achieving  the  goals  of  the  adult 
learning  system. 

The  long-term  goal  of  the  KPI  project  has  been  to  develop  indicators  that  account  for  all  of  institutions' 
educational  offerings,  whether  credit  or  non-credit.    Phase  One  of  the  project  focused  on  parchment 
programs  which  are  primarily  funded  by  the  taxpayer,  and  have  a  well  established  reporting  system  (the 
Common  Information  System)  to  describe  them.  Many  other  courses  and  activities,  which  also  form  an 
important  part  of  institutions'  educational  offerings,  could  not  be  incorporated  in  any  meaningful  way 
into  Phase  One  since  no  system- wide  categorization  reflected  the  diversity  of  this  other  programming. 
Much  of  this  other  programming  is  generally  considered  non-credit  by  both  the  institutions  and  the 
department.  The  developmental  work  required  to  adequately  reflect  this  diversity  was  left  until  Phase 
Two  of  the  KPI  project.^ 


Credit  programming  is  operationalized  as  all  programs  reported  in  the  Common  Information  System  (CIS).  All 
offerings  not  reported  in  CIS  are  considered  to  be  non-credit. 

^  In  addition  to  incorporating  non-credit  courses  and  activities,  the  goals  of  Phase  Two  included  making 
improvements  to  the  Phase  One  indicators  and  addressing  matters  such  as  alternate  delivery  methods  (including 
brokerage  and  collaborative  arrangements)  and  the  service  institutions  provide  to  their  community.  The  next  steps  in 
Phase  Two  will  focus  on  these  matters. 


KPI  Reporting  Manual  -  November  1997 


Page  A 1 


Revisions  to  15/12/97 


1.2      Purpose  of  the  Consultation 


Universities,  public  colleges,  technical  institutes  and  the  Alberta  vocational  colleges  (AVCs)  were 
consulted  for  their  advice  on  some  cost-effective  ways  to  better  represent  the  programming  and  activities 
in  the  non-credit  areas  of  their  institutions  (see  Appendix  B  for  a  list  of  participants  and  meeting  dates) 
The  goal  of  the  consultation  was  to  establish,  system-wide,  consistent  methods  for  counting  and 
categorizing  information  on  non-credit  programming.  Specifically,  this  entailed: 

•  having  institutions  agree  upon  a  common  subject  classification  that  could  be  used  to  categorize 
courses  and  programs  into  broad  subject  areas ;^ 

•  establishing  a  categorization  system  that  would  adequately  reflect  the  wide  diversity  of  programming 
in  the  non-credit  area,  which  ranges  from  short  courses  to  programs  that  culminate  in  some  type  of 
certification;  and 

•  exploring  the  extent  to  which  registrations,  student  contact  hours,  and  unduplicated  headcount  (the 
only  non-credit  indicators  currently  required  in  the  KPI  reporting  structure)  were  consistently  defined 
and  interpreted  across  the  system,  and  where  necessary,  amending  the  current  definitions  to  ensure 
that  high  quality  data  can  be  reported  in  the  future. 

Aside  from  this  primary  goal,  the  consultation  also  provided  institutions  and  the  department  with  an 
opportunity  to  consider  new  indicators  which  might  be  useful  in  measuring  relative  success  in  achieving 
additional  goals  of  the  adult  learning  system. 

1.3      The  Consultation  Process 

The  consultation  operated  in  two  stages.  Round  One  began  with  the  public  colleges  and  technical 
institutes,  institutions  whose  non-credit  programming  forms  a  large  portion  of  their  educational  offerings 
(See  Appendix  C  for  a  summary  of  non-credit  registrations  across  the  public  post- secondary  system). 
Meetings  were  held  with  these  institutions  in  the  winter  of  1996/97.  A  discussion  paper  arose  out  of  this 
round  of  consultations,  which  synthesized  the  results  of  the  meetings  and  made  recommendations  for  a 
new  non-credit  reporting  structure.^ 

This  discussion  paper  was  then  returned  to  the  colleges  and  technical  institutes  for  their  comment,  and 
used  as  background  for  the  second  stage  meetings  which  were  held  with  the  AVCs  and  universities  in  the 
spring  of  1997.  By  May  1997  all  but  one  of  the  institutions  that  participated  in  the  consultation  had 
provided  their  comments  on  the  discussion  paper. 


2.0     Feedback  on  the  Recommendations  and  Reporting  Structure 


^  The  University  of  Lethbridge  and  Athabasca  University  advised  that  they  do  not  offer  non-credit  programming. 

^  Historically,  institutions  used  at  least  3  subject  classification  systems  for  reporting  non-credit  courses  to  the 
department.  Some  institutions  used  the  Non-Credit  Course  Classification  Structure,  a  departmental  document 
developed  by  the  Policy  Development  branch,  some  used  the  Further  Education  Program  Course  Code  System 
and  Manual,  and  some  institutions  used  their  own  systems.  This  lack  of  commonality  across  institutions  prevented 
non-credit  course  information  from  being  reported  to  KPIRS  (the  KPI  reporting  system)  at  any  level  lower  than  the 
institutional  level. 

^  See  Bellan,  S.  (1997)  Non-Credit  Key  Performance  Indicators:  A  Discussion  Paper.  Edmonton:  Clarity 
Consulting  and  Research. 


KPI  Reporting  Manual  -  November  1997 


Page  a2 


Revisions  to  15/12/97 


The  recommendations  and  reporting  structure  proposed  in  the  discussion  paper  were  endorsed,  in 
principle,  by  all  of  the  universities,  colleges,  technical  institutes  and  AVCs  that  responded  to  the 
discussion  paper.  Suggestions  for  further  refinements  or  amendments  were  incorporated  and 
appear  in  the  revised  recommendations,  reporting  structure  and  definitions  in  section  3.0  (see 
Appendix  E  for  a  listing  of  some  specific  comments  on  the  recommendations  and  reporting 
structure). 


3.0  Final  Recommendations 

3.1  Recommendations 

The  following  recommendations  are  based  on  the  results  of  the  consultation: 
Scope  of  Reporting 

•  Despite  the  fact  that  all  institutions  provide  service  to  their  communities  in  the  form  of  non-credit 
activities  (such  as  renting  out  institutional  space  or  sending  instructors  to  speak  on  specific  topics  at 
the  request  of  community  members),  it  was  agreed  that  the  scope  of  reporting  should  be  limited  to 
courses,  flexible  programs  and  programs  (as  defined  in  section  3.3). 

Programming  Categories  and  Sub-Categories 

•  In  order  to  reflect  the  diversity  of  programming  across  the  system,  the  KPI  reporting  structure  should 
contain  categories  for  three  mutually  exclusive  programming  types:  programs,  flexible  programs  and 
courses. 


•  In  addition,  in  order  for  institutions  to  be  able  to  highlight  the  customized  training  they  offer  and  for 
the  department  to  be  able  to  supply  important  basic  information  about  the  adult  learning  system  (i.e. 
the  number  of  adults  the  system  serves),  there  should  be  two  sub-categories  in  the  reporting  structure 
~  one  for  customized  training  and  one  for  programming  for  children. 

•  In  terms  of  the  interaction  between  indicators  and  main  and  sub-categories,  indicators  (e.g., 
registrations,  student  contact  hours  and  unduplicated  headcount)  from  a  sub-category  would  be 
included  in  the  main  programming  category  (courses  or  programs)  to  form  a  total,  and  would  also  be 
visible  in  the  sub-category  as  a  subtotal  of  the  main  programming  category. 

Level  of  Reporting 

•  In  order  to  reflect  the  broad  subject  mix  of  non-credit  programming  across  the  system,  programs  and 
courses  should  be  reported  at  the  broad  subject  level,  (as  they  were  prior  to  the  development  of  the 
KPI  reporting  structure),  but  the  previously  used  subject  classification  systems  should  be  replaced  by 
the  subject  classification  system  currently  in  use  in  the  KPI  reporting  structure  for  describing  the 
content  of  credit  programming  (See  Appendix  F  for  a  detailed  explanation  of  how  courses  and 
programs  would  be  coded  using  the  new  system). 
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•    To  ensure  that  programs  and  courses  are  consistently  coded,  both  across  institutions,  and  within  an 
individual  institution  from  year  to  year,  the  department  should  hold  a  workshop  for  institutional  staff 
soon  after  the  new  non-credit  reporting  structure  receives  final  approval.  This  workshop  would 
address  questions  about  the  new  classification  system  and  begin  to  establish  guidelines  for  ensuring 
the  collection  of  valid  and  comparable  data.  In  addition,  it  is  recommended  that  institutional  staff 
responsible  for  the  coding  join  the  KPI  Listservers  so  that  questions  and  answers  on  coding  issues 
will  be  seen  by  all  other  coders  across  the  province.  ^ 


•  The  indicators  falling  into  these  main  programming  categories  (programs,  flexible  programs  and 
courses)  will,  at  a  minimum,  be  reported  at  the  KPI  subject  area  level.'^  However,  KPIRS  will  be 
designed  to  accommodate  a  finer  level  of  detail  (the  CIS  3-digit  classification  code  level)  for 
institutions  who  wish  to  report  at  this  level.  In  order  to  reduce  reporting  burden,  the  sub-categories 
(customized  training  and  programming  for  children)  will  be  reported  at  the  institutional  level. 

Access  Indicators 

•  All  institutions  should,  over  a  reasonable  period  of  time,  move  towards  adopting  registration  systems 
that  will  allow  unduplicated  headcount  to  be  generated. 


•    The  definitions  of  registrations,  smdent  contact  hours  and  unduplicated  headcount  in  the  KPI 
Reporting  Manuals  should  be  amended  to  incorporate  what  was  learned  in  the  consultation. 
Amended  definitions  appear  in  section  3.3. 


^  Two  Listervers  are  in  place  to  deal  with  concerns  related  to  Key  Performance  Indicators,  one  for  the  colleges 
sector  and  one  for  the  universities.  Instructions  for  joining  each  Listserver  are  located  in  the  relevant  KPI  reporting 
manuals. 

Because  of  the  work  that  institutions  would  need  to  undertake  to  report  unduplicated 
headcount  at  the  subject  area  level,  unduplicated  headcount  will  initially  be  reported  at  the  institutional  level  only. 
If,  after  the  collection  of  pilot-year  data,  some  institutions  want  the  ability  to  report  unduplicated  headcount  at  the 
subject  area  level,  KPIRS  can  be  modified  to  accommodate  this. 
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Potential  Indicators  Arising  from  New  Programming  Categories 

•  A  measure  indicating  the  number  of  completers  should  be  incorporated  into  the  main  programming 
category  of  flexible  programs.  This  is  suggested  not  with  a  view  to  calculating  a  completion  rate, 
which  would  be  an  inappropriate  indicator  for  flexible  program  completers,  but  is  necessary  in  order 
to  recognize  this  as  a  category.  Since  students  in  these  programs  register  in  courses  in  the  program, 
not  in  the  program  itself,  without  a  completer  indicator  there  is  no  way  to  distinguish  students  in 
flexible  programs  from  students  in  courses. 

•  Consistent  with  the  fact  that  there  was  some  interest  in  implementing  exit  (satisfaction)  surveys  for 
completers  of  flexible  programs,  and  both  exit  (satisfaction)  surveys  and  follow-up  surveys  for 
completers  of  programs,  the  department  and  institutions  should  give  further  consideration  to  using 
these  indicators. 

Interest  in  New  Indicators 

•  Consistent  with  the  fact  that  there  was  very  little  support  for  developing  a  cost  per  student  contact 
hour  there  should  be  no  development  of  such  an  indicator.  Moreover,  it  is  critical  that  the  currently 
available  information  on  student  contact  hours  and  non-credit  costs  (as  described  on  p.78  of  the 
Colleges  and  Technical  Institutes  Key  Performance  Indicators  Reporting  Manual)  not  be  used  to 
calculate  a  cost  per  student  contact  hour  since  the  categories  included  on  the  costing  side  may  not 
match  the  categories  on  the  student  contact  hour  side. 

•  There  should  be  no  development  of  a  new  unit  of  standardization  for  the  non-credit  realm. 
Institutions  and  the  department  are  prepared  to  continue  using  student  contact  hours  both  for 
comparing  institutions  in  the  non-credit  realm,  and  for  combining  non-credit  hours  with  hours  from 
the  credit  realm  to  indicate  the  total  level  of  service  provided  by  a  given  institution. 

•  Any  new  indicators  proposed  for  the  non-credit  realm  beyond  those  already  in  use  in  the  KPI 
reporting  manual  should  focus  on  customer  satisfaction  and  programming  quality. 
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3.2       Proposed  Reporting  Structure 


The  reporting  structure  below  displays  the  indicators  that  will  be  reported  to  the  KPI  reporting  system 
(KPIRS).  The  third  row  shows  the  indicators  that  will  be  reported  in  each  category  and  sub-category;  the 
second  row  shows  the  level  that  these  indicators  will  be  reported  at;  and  the  first  row  shows  the  category 
in  which  students  register.  This  row  has  been  included  primarily  to  show  the  relationship  between  the 
flexible  program  category  and  the  course  category. 
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*      Indicators  (registrations,  student  contact  hours,  headcount)  in  a  sub-category  are  reported  both  in 
the  sub-category  and  in  the  main  category  of  which  they  are  a  part.  For  example,  at  a  given  institution 
the  total  number  of  registrants  in  courses  contains  information  on  all  courses,  including  courses  for 
children  and  customized  training  courses.  These  subsets  of  registrants  are  also  displayed  in  the 
appropriate  sub-category  to  indicate  the  sub-category  proportions  relative  to  the  main  category.  In 
addition,  the  number  of  registrants  in  a  sub-category  can  be  subtracted  from  the  number  of  registrants 
in  the  main  category  (which  would  be  necessary  to  calculate  the  total  number  of  adult  learners 
served). 

**      Students  in  flexible  programs  register  in  courses  in  the  program,  not  in  the  program  itself,  and 
these  courses  only  form  a  program  once  all  of  them  have  been  completed.  Therefore,  reporting  the 
number  of  flexible  program  completers  is  necessary  to  recognize  this  as  a  category. 
***     The  "dashed"  box  under  the  flexible  program  category  represents  the  fact  that  students  in 
flexible  programs  register  in  courses  in  the  program  and  are  reported  under  the  courses  category. 
****   Unduplicated  headcount  will  initially  be  reported  at  the  institutional  level  only  because  of  the 
work  that  would  be  required  to  report  unduplicated  headcount  at  the  subject  area  level. 


KPI  Reporting  Manual  -  November  1997 


Page  a6 


Revisions  to  15/12/97 


3.3  Definitions 


Completer  -  An  individual  who  has  been  awarded  some  type  of  certification  (a  certificate  or  certificate 
of  achievement)  either  by  a  particular  institution  or  by  a  given  professional  association  upon  completion 
of  a  flexible  program. 

Course  -  Organized  subject  matter  with  pre-determined  curriculum,  and  set  of  specified  learning 
outcomes  delivered  to  a  learner  usually  over  a  specified  period  of  time.  Within  institutions,  courses  may 
be  referred  to  by  other  labels,  such  as  seminars,  workshops,  etc.  The  label  is  not  important  in  determining 
whether  an  educational  offering  is  to  be  considered  a  course.  For  KPI  reporting  purposes,  any  offering 
meeting  the  above  criteria  is  a  course.  (Note:  GED  testing  sessions  and  admission  information  sessions 
do  not  meet  the  criteria  of  the  course  definition.  In  addition,  conferences  that  do  not  have  specified 
learning  outcomes  should  not  be  considered  courses). 

Customized  Training  -  A  course  or  program  in  which  the  curriculum  has  been  customized  to  meet  the 
specific  training  or  educational  needs  of  a  business  or  agency.  These  courses  are  generally  not  open  to 
the  general  public.  For  administrative  purposes,  the  primary  relationship  is  between  the  institution  and 
the  client,  not  between  the  institution  and  an  individual  learner.  (Note:  The  access  indicators 
(registrations,  unduplicated  headcount,  and  student  contact  hours)  describe  the  students  taking  the 
customized  training  not  the  client  for  whom  the  training  was  designed). 

Flexible  Program  -  A  collection  of  courses  related  by  a  common  purpose,  all  of  which  must  be 
successfully  completed  for  students  to  receive  certification.  For  reporting  purposes,  students  register  in 
courses  in  the  program,  not  in  the  program  itself. 

Headcount  (Annual)  -  The  total  number  of  students  (unduplicated  headcount)  participating  in  programs 
or  courses  not  recognized  for  credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year.  Institutions 
who  are  currently  unable  to  calculate  unduplicated  headcount  should  leave  this  field  blank  in  KPIRS. 
However,  all  institutions  should,  over  a  reasonable  period  of  time,  move  towards  adopting  registration 
systems  that  will  allow  unduplicated  headcount  to  be  generated.  As  with  credit  reporting,  learning 
activities  that  have  been  reported  by  another  institution  through  a  brokering  arrangement  should  not  be 
included  in  the  headcount. 

Program  -  A  collection  of  courses  related  by  a  common  purpose,  all  of  which  must  be  successfully 
completed  for  students  to  receive  certification  (if  any  is  conferred).  For  reporting  purposes,  students 
register  in  the  given  program,  not  in  the  courses  that  comprise  it.  Some  programs  may  also  be 
completed  in  a  flexible  manner.  However,  regardless  of  the  degree  of  flexibility,  if  students  are 
registered  in  programs  not  courses,  they  are  considered  to  be  part  of  the  program  category,  not  the 
flexible  program  category. 

Programming  for  Children  -  All  courses  or  programs  designed  by  the  institution  to  be  offered  to 
individuals  under  18  years  of  age.  (Note:  The  access  indicators  in  this  category  are  not  intended  to 
represent  every  student  under  the  age  of  18.  While  it  is  possible  that  individuals  under  this  age  may  be 
enrolled  in  courses  or  programs  that  are  not  specifically  designed  for  children,  since  not  all  institutions 
collect  age  information  on  their  non-credit  registrants  (as  they  do  with  their  CIS  registrants),  not  every 
institution  would  have  the  capability  of  supplying  this  information). 
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Registrations  (Annual)  -  The  total  number  of  students  enrolled  in  courses  or  programs  not  recognized 
for  credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year  (Note:  Course  registrations  and  program 
registrations  are  mutually  exclusive.  That  is,  registrations  reported  in  the  program  category  are  not  to  be 
reported  in  the  course  category).  A  student  enrolled  in  a  course  or  program  which  is  subsequently 
cancelled  should  not  be  included  in  the  count.  A  student  withdrawing  before  that  course  or  program's 
withdrawal  date  should  not  be  included  in  the  count;  a  student  withdrawing  after  the  course  or  program 
withdrawal  date  should  be  included  in  the  count.  Since  students  may  be  registered  in  more  than  one 
course  or  program  within  a  given  institution,  registration  counts  are  generally  higher  than  unduplicated 
headcounts. 

Student  Contact  Hours  (Annual)  -  An  aggregation  of  the  product  of  the  number  of  registrations,  the 
number  of  weeks  and  the  number  of  contact  hours  per  week  in  each  course  or  program  not  recognized  for 
credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year.  In  courses  or  programs  that  are  not 
delivered  in  a  traditional  format  (that  is,  not  in  a  classroom  with  an  instructor  present),  the  number  of 
contact  hours  that  would  have  been  accumulated  had  the  course  been  offered  in  the  traditional  manner 
should  be  used  as  a  proxy  for  acmal  student  contact  hours. 
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4.0    Action  Plan 


After  the  non-credit  reporting  structure  has  received  final  departmental  approval,  institutions  will  use  the 
new  structure  to  categorize  non-credit  data  for  the  1997-98  academic  year.''  This  data  will  be  reported  to 
the  KPI  Reporting  System  (KPIRS)  for  the  first  time  in  the  fall  of  1998.  There  will  be  no  retroactive 
coding  of  past  years'  data. 

•  May  1997  -    The  final  report  on  non-credit  Key  Performance  Indicators  is  distributed  to  institutions 
for  comments. 

•  May  1997  -    The  new  non-credit  reporting  structure  receives  final  departmental  approval. 

•  May  1997  -    Universities  begin  to  count  non-credit  programming  for  the  1997-98  academic  year 
using  the  new  non-credit  reporting  structure.  (Since  the  universities'  academic  year  runs  from  April  1 
-  March  31,  a  small  amount  of  retroactive  coding  will  be  required). 

•  July  1997  -  Colleges,  technical  institutes  and  Alberta  vocational  colleges  begin  to  count  non-credit 
programming  for  the  1997-98  academic  year  using  the  new  non-credit  reporting  structure. 

•  Summer  1997  -  The  department  holds  a  coding  workshop  for  institutional  staff. 

•  November  1998  -  The  department  distributes  revised  KPI  Reporting  Manuals  and  KPIRS  software. 

•  January  1999  -  Institutions  submit  KPI  data  for  the  1997-98  academic  year. 


In  the  non-credit  realm,  academic  years  run  from  April  1  to  March  3 1  in  the  university 
sector  and  from  July  1  to  June  30  in  all  other  sectors. 
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Appendix  B 

Alberta  Universities'  Student  Satisfaction  Survey  Instrument 


Hello.  May  I  please  speak  to  .   Hi,  my  name  is  and  I'm 

calling  from  The  Advisory  Group.  We  are  conducting  a  survey  on  behalf  of  the  Universities  of 
Alberta,  Calgary,  Lethbridge  and  Athabasca  University.  We  are  interested  in  finding  out  what  you 
think  of  your  educational  experience.  This  telephone  questionnaire  will  take  approximately  15 
minutes  of  your  time.  Your  participation  is  voluntary,  and  your  identity  as  a  participant  is 
completely  confidential.  There  are  no  questions  that  will  identify  you  individually.  Would  you  be 
able  to  provide  that  time  for  us  now? 

[IF  YES,  CONTINUE.  IF  NO,  ARRANGE  CALLBACK:  ] 

[ALL  STUDENTS  SHOULD  HAVE  BEEN  MAILED  A  LETTER  FROM  THEIR  RESPECTIVE  UNIVERSITY 
INFORMING  THEM  OF  THIS  SURVEY.] 

[IF  THE  STUDENT  QUESTIONS  THE  VALIDITY  OF  THE  STUDY,  PLEASE  TELL  THEM  THEY  CAN 
CONTACT  THE  FOLLOWING  PERSON  FOR  VERIFICATION: 

U  OF  A:  MR.  BRL\N  SILZER,  ASSOCL\TE  V.P.  REGISTRAR,  492-3723 

U  OF  C:  DR.  PEGGY  PATTERSON,  ASSOCIATE  VICE  PRESIDENT  (STUDENT  AFFAIRS),  220-6580 

U  OF  L:  DR.  KEITH  McCURDY,  DEAN  OF  STUDENT  AFFAIRS,  329-2593 

AU:  DR.  RICK  POWELL,  HEAD  OF  INSTITUTIONAL  STUDIES,  675-6220] 

Section  One:  BACKGROUND  INFORIVIATION 

First  of  all,  I  need  to  gather  some  background  information  from  you: 

1.1     From  what  Faculty  are  you  graduating: 

[INSTRUCTION  TO  INTERVIEWERS:  DO  NOT  READ  LIST.  CLARIFY  FACULTY  IF  NECESSARY. 
IF  FACULTY  NOT  LISTED,  OR  IF  MORE  THAN  ONE  FACULTY  IS  GIVEN,  SPECIFY  IN  'OTHER'. 
DO  NOT  USE  THE  OTHER  CATEGORY  WITHOUT  CHECKING  WITH  THE  SUPERVISOR  DURING 
YOUR  EDIT.  DO  NOT  CODE  MINORS.] 

University  of  Alberta: 


n. 

Agriculture  and  Forestry  and  Home  Economics 

12. 

Arts 

13. 

Business 

14. 

Dentistry 

15. 

Education 

16. 

Engineering 

17. 

Law 

18. 

Medicine 

19. 

School  of  Native  Studies 

110. 

Nursing 

111. 

Pharmacy  &  Pharmaceutical  Sciences 

112. 

Physical  Education  &  Recreation 

113. 

Rehabilitation  Medicine 

114. 

Saint- Jean 

115. 

Science 

116. 

Other  (i.e.,  if  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 
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0.  No  answer 
University  of  Calgary: 

21.  Education 

22.  Engineering 

23.  Fine  Arts 

24.  General  Studies 

25.  Humanities 

26.  Kinesiology 

27.  Law 

28.  Management 

29.  Medicine 

210.  Nursing 

211.  Science 

212.  Social  Sciences 

213.  Social  Work 

214.  Other  (i.e.,  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 


0.  No  answer 

University  of  Lethbridge: 

[INSTRUCTIONS  TO  INTERVIEWER:  IF  U  OF  L  STUDENT  RESPONDS,  "EDUCATION"  THIS 
MUST  BE  CLARIFIED  AS  EITHER  COMBINED  DEGREE  PROGRAM  (I.E.,  A  DUAL  DEGREES 
PROGRAM  IN  EDUCATION  AND  ANOTHER  FACULTY)  OR  THE  NON-COMBINED  DEGREES 
PROGRAM.  IF  COMBINED  DEGREES  PROGRAM,  MARK  "31".  IF  NON-COMBINED  DEGREES 
PROGRAM,  MARK  "33".] 

31.  Education  and  another  faculty,  in  the  combined  degrees  program  in  teacher  preparation 

[INSTRUCTIONS  TO  INTERVIEWER:  IF  U  OF  L  RESPONSE  IS  "31"  MODIFY  THE  WORDING  OF 
QUESTIONS  3.3  AND  3.8  AS  SPECIFIED  LATER  ON.] 


32. 

Arts  and  Science 

33. 

Education  (excluding  combined  degrees  program) 

34. 

School  of  Fine  Arts 

35. 

Management 

36. 

School  of  Nursing 

37. 

Other  (i.e..  Faculty  not  listed  above  or  if  more  than  one  Faculty,  excluding  the  Education 

combined  degrees  program,  please  specify) 

0. 

No  answer 

Athabasca  University: 

41.  Arts 

42.  Administration 

43.  Commerce 

44.  General  Studies 

45.  Nursing 

46.  Science 

47.  Other  (i.e.,  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 


0.        No  answer 


1.2     What  degree(s)  vnll  be  awarded  to  you  at  convocation? 
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[INSTRUCTION  TO  INTERVIEWERS:  IF  MORE  THAN  ONE  DEGREE  GIVEN,  CLARIFY  AS  A 
DUAL  DEGREE  AND  LIST  BOTH.  DO  NOT  CODE  MINORS.] 


(record  verbatim) 


1.3     What  is  your  major? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  MORE  THAN  ONE  MAJOR  GIVEN,  CLARIFY  AS  A  DUAL 
MAJOR  AND  LIST  BOTH.  DO  NOT  CODE  MINORS.] 


1.4     Did  you  enter  the  University  as  a  transfer  student  (i.e.  you  received  some  advanced  credit 
for  work  accomplished  at  another  post-secondary  institution)? 

[INSTRUCTION  TO  INTERVIEWERS:  AFTER  DEGREE  STUDENTS  ARE  NOT  CONSIDERED 
"TRANSFER  STUDENTS."] 


Section  Two:  FINANCES 

The  next  section  has  two  questions  relating  to  finances. 

2.1  Considering  all  years  of  your  degree  program,  which  of  the  following  was  the  main  source  of 
financial  support  for  your  education?  I  will  read  you  a  list  of  possible  sources  so  you  can 
consider  all  of  them  in  your  response. 

[INSTRUCTIONS  TO  INTERVIEWER:  READ  LIST.  CLARIFY  RESPONSE  AS  MAIN  SOURCE.  IF 
MORE  THAN  ONE  RESPONSE  PROVIDED,  CLARIFY  EACH  AS  A  MAIN  SOURCE.  ALLOW  UP  TO 
FOUR  RESPONSES.] 


1. 

Parents 

2. 

Spouse/partner 

3. 

Personal  savings 

4. 

Provincial  and/or  Canada  student  loans 

5. 

Other  loans 

6. 

Scholarships/bursaries 

7. 

Employment  from  Co-op  work  term 

8. 

Employment  during  school  term  (full  or  part-time) 

10. 

Or  some  other  source  (please  specifv) 

0. 

No  answer                            [DO  NOT  READ] 
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(record  verbatim) 


1. 
2. 
0. 


Yes 
No 

No  answer 


2.2  Did  you  receive  government  student  loans  to  help  finance  your  education? 

[IF  NO,  CIRCLE  "1",  AND  CONTINUE.] 

[IF  YES,  ASK:]  What  is  your  total  estimated  debt  load  at  the  time  of  graduation? 

[READ  LIST] 


L 

Nil 

2. 

$  5,000  or  less 

3. 

$5,001  -  10,000 

4. 

$10,001  -  15,000 

5. 

$15,001  -20,000 

6. 

$20,001  -  25,000 

7. 

$25,001  -  30,000 

8. 

IVlore  than  $30,000 

0. 

No  answer 

[DO  NOT  READ] 


Section  Three:  EDUCATIONAL  EXPERIENCE 

The  following  questions  ask  you  to  evaluate  various  aspects  of  your  educational  experience  at  the 
University.  For  all  of  these  items,  if  you  do  not  have  an  opinion,  please  say  so  and  we  will  go  on  to 
the  next  question.  Please  answer  on  a  scale  of  1  to  5  where  1  means  very  dissatisfied,  2  is 
dissatisfied,  3  means  neither  satisfied  nor  dissatisfied,  4  is  satisfied,  and  5  means  very  satisfied. 


3.1      How  would  you  rate  your  satisfaction  with  . . .  [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  "NO  ANSWER."  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Very 

Neither  satisfied 

Very 

No  Ans\ 

Dissatisfied  Dissatisfied 

nor  dissatisfied 

Satisfied 

Satisfied 

[DO  NOT 

I. 

Classrooms 

1  2 

3 

4 

5 

0 

2. 

Laboratories 

1  2 

3 

4 

5 

0 

3. 

Computer  facilities 

1  2 

3 

4 

5 

0 

4. 

Library  holdings 

1  2 

3 

4 

5 

0 

5. 

Library  hours 

1  2 

3 

4 

5 

0 

6. 

Study  space 

1  2 

3 

4 

5 

0 

7. 

Bookstore 

1  2 

3 

4 

5 

0 

8. 

Safety  on  campus 

1  2 

3 

4 

5 

0 

9. 

Registration 

1  2 

3 

4 

5 

0 

10. 

Average  size  of  your  classes 

1  2 

3 

4 

5 

0 

11. 

Course  material  packages 

1  2 

3 

4 

5 

0 
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3.2  Using  the  same  scale,  how  would  you  rate  your  satisfaction  with  any  of  the  following 
university  services  that  you  have  utilized?  Please  let  us  know  if  you  have  not  used  the 
service.  How  would  you  rate  . . .  [READ  SCALE  AGAIN,  IF  NECESSARY.  READ  AND  ROTATE 
ITEMS]? 


[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  "NO  ANSWER."  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Very 

Neither  satisfied 

Very 

No  Ans\ 

Dissatisfied 

Dissatisfied 

nor  dissatisfied 

Satisfied 

Satisfied 

[DO  NOT 

1. 

Services  for  students  with  disabilities  1 

2 

3 

4 

5 

0 

2. 

University  residences  1 

2 

3 

4 

5 

0 

3. 

Campus  recreation  facilities  1 

2 

3 

4 

5 

0 

4. 

Campus  recreation  programs  1 

2 

3 

4 

5 

0 

5. 

Parking  facilities  1 

2 

3 

4 

5 

0 

6. 

Health  services  1 

2 

3 

4 

5 

0 

7. 

Orientation  services  for  new  students  1 

2 

3 

4 

5 

0 

8. 

Career  counselling  1 

2 

3 

4 

5 

0 

9. 

Academic  advising  1 

2 

3 

4 

5 

0 

10. 

Campus  food  services  1 

2 

3 

4 

5 

0 

11. 

Personal/crisis  counselling  1 

2 

3 

4 

5 

0 

12. 

Students'  Union  1 

2 

3 

4 

5 

0 

13. 

University  day  care  1 

2 

3 

4 

5 

0 

3.3       Please  answer  the  following  question  in  reference  to  the  courses  you  took  and  experiences 
you  had  in  your  own  Faculty. 

[INSTRUCTIONS  TO  INTERVIEWERS:  FOR  U  OF  L  STUDENTS  IN  THE  COMBINED  DEGREES 
PROGRAM  IN  TEACHER  PREPARATION,  REWORD  THE  QUESTION:  "PLEASE  ANSWER  THE 
FOLLOWING  QUESTION  IN  REFERENCE  TO  THE  COURSES  YOU  TOOK  AND  EXPERIENCES 
YOU  HAD  IN  THE  FACULTY  OF  EDUCATION."] 

[FOR  STUDENTS  FROM  OTHER  UNIVERSITIES  IN  DUAL  FACULTIES,  ASK  THEM  TO 
RESPOND  IN  GENERAL  TO  BOTH  FACULTIES.] 

These  questions  are  phrased  as  statements;  please  indicate  whether  you  strongly  disagree, 
disagree,  neither  agree  nor  disagree,  agree,  or  strongly  agree  with  each  statement. 

[REPEAT  ANSWER  CHOICES  AFTER  EACH  QUESTION  IF  NECESSARY]. 

In  general,  most  of  your  instructors  . . .  [READ  AND  ROTATE  ITEMS]? 

Strongly  Neither  agree  Strongly      No  Answer 

Disagree       Disagree         nor  disagree      Agree     Agree     [DO  NOT  READ] 

1 .      Conducted  classes  in  a  well-planned 


manner 

1 

2 

3 

4 

5 

0 

2. 

Explained  concepts  clearly 

1 

2 

3 

4 

5 

0 

3. 

Answered  students'  questions  clearly 

1 

2 

3 

4 

5 

0 

4. 

Presented  course  materials  in  an 

interesting  way 

1 

2 

3 

4 

5 

0 

5. 

Displayed  enthusiasm  in 

conducting  class  sessions 

1 

2 

3 

4 

5 

0 

6. 

Showed  concern  for  student  progress 

1 

2 

3 

4 

5 

0 
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Strongly 

Neither  agree 

Strongly 

No  Answer 

Disagree 

Disagree 

nor  disagree 

Agree 

Agree 

[DO  NOT  READ] 

7. 

Offered  to  help  students  with  problems 

1 

2 

3 

4 

5 

0 

8. 

Treated  students  with  respect 

1 

2 

3 

4 

5 

0 

9. 

Were  available  for  individual 

consultation  with  students 

1 

2 

3 

4 

5 

0 

10. 

Communicated  course  objectives  and 

requirements  clearly 

1 

2 

3 

4 

5 

0 

11. 

Met  the  course  objectives  in  their 

teaching 

1 

2 

3 

4 

5 

0 

12. 

Used  methods  of  evaluation 

(e.g.,  quizzes,  assignments,  papers, 

exams)  that  provided  a  fair  evaluation 

of  student  leaming 

1 

2 

3 

4 

5 

0 

13. 

Graded  student  work  promptly 

1 

2 

3 

4 

5 

0 

14. 

Provided  helpful  comments  and 

feedback  where  appropriate 

1 

2 

3 

4 

5 

0 

15. 

Were  effective  as  university  teachers 

1 

2 

3 

4 

5 

0 

The  following  questions  examine  the  degree  to  which  your  education  at  the  University  has  added  to 
your  skills.  Again,  the  questions  are  phrased  as  statements  and  the  answer  categories  are  strongly 
disagree,  disagree,  neither  agree  nor  disagree,  agree,  and  strongly  agree. 

3.4       Reflecting  upon  your  educational  experience  at  the  University,  do  you  feel  that  it  has 
helped  you  to  . . .  [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  "NO  ANSWER."  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 

Strongly  Neither  agree  Strongly       No  Answer 


Disagree 

Disagree 

nor  disagree 

Agree 

Agree 

[DO  NOT 

1. 

Develop  problem-solving  skills  1 

2 

3 

4 

5 

0 

2. 

Speak  effectively  1 

2 

3 

4 

5 

0 

3. 

Write  effectively  1 

2 

3 

4 

5 

0 

4. 

Develop  conflict-resolution  skills  1 

2 

3 

4 

5 

0 

5. 

Become  motivated  to  acquire  knowledge  1 

2 

3 

4 

5 

0 

6. 

Develop  self-confidence  1 

2 

3 

4 

5 

0 

7. 

Develop  leadership  skills  1 

2 

3 

4 

5 

0 

8. 

Think  creatively  1 

2 

3 

4 

5 

0 

9. 

Develop  awareness  of  ethical  issues  1 

2 

3 

4 

5 

0 

10. 

Develop  awareness  of  political  issues  1 

2 

3 

4 

5 

0 

11. 

Appreciate  other  cultures  1 

2 

3 

4 

5 

0 

12. 

Develop  computer  literacy  1 

2 

3 

4 

5 

0 

13. 

Develop  information  management  skills  1 

2 

3 

4 

5 

0 

14. 

Work  independently  1 

2 

3 

4 

5 

0 

15. 

Work  well  with  others  1 

2 

3 

4 

5 

0 

16. 

Develop  interpersonal  skills  1 

2 

3 

4 

5 

0 
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The  following  questions  examine  your  reasons  for  attending  university.  Using  the  same  response 
categories  as  before,  please  state  your  level  of  agreement  to  each  statement  [READ  SCALE  AGAIN,  IF 
NECESSARY]. 

3.5       Your  objective  in  attending  the  University  was  to  . . .  [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  "NO  ANSWER."  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Strongly 

Neither  agree 

Strongly 

No  Answer 

Disagree 

Disagree      nor  disagree  Agree 

Agree 

[DO  NOT  READ] 

1 .  Find  opportunities  for  personal  development  1 

2            3  4 

5 

0 

2.  Prepare  for  lifelong  learning  1 

2            3  4 

5 

0 

3.  Qualify  for  another  program  of  studies  1 

2            3  4 

5 

0 

4.  Improve  the  possibility  of  a  good  income  1 

2            3  4 

5 

0 

5.  Gain  skills  needed  for  a  particular  career  1 

2            3  4 

5 

0 

6.  Gain  in-depth  knowledge  of  a  field  of  smdy  1 

2            3  4 

5 

0 

7.  Acquire  breadth  of  knowledge 

of  a  field  of  study  1 

2           3  4 

5 

0 

8.  Friends  were  going  to  university  1 

2           3  4 

5 

0 

9.  Aside  from  those  mentioned,  what  other  objectives,  if  any,  did  you  have  for  attending  University? 

Colease  soecifv) 

[         SUPERVISOR:  CHECK  TO  ENSURE  RESPONSE  DOES  NOT  APPEAR  ABOVE] 

Again,  using  the  same  scale  as  before,  please  indicate  the  extent  to  which  the  program  you 

completed  provided  you  with  the  following  benefits? 

3.6       A  Benefit  of  your  University  education  is  that  it . . .  [READ  AND  ROTATE  ITEMS]. 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 

FOR  ANY  REASON,  CODE  AS  "NO  ANSWER." 

REPEAT  ANSWER  CHOICES  AFTER  EACH 

QUESTION  IF  NECESSARY.] 

Strongly 

Neither  agree  Strongly 

No  Answer 

Disagree 

Disagree      nor  disagree  Agree 

Agree 

[DO  NOT  READ] 

1 .       Provided  skills  needed  for  a  particular 

career  1 

2            3  4 

5 

0 

2.       Gave  you  in-depth  knowledge  of  a 

field  of  study  1 

2           3  4 

5 

0 

3.       Provided  an  opportunity  for 

personal  development  1 

2           3  4 

5 

0 

4.       Improved  the  possibility  of  a  good 

income  1 

2            3  4 

5 

0 

5.       Allowed  you  to  qualify  for  another 

program  of  studies  1 

2           3  4 

5 

0 

3.7       Using  the  descriptors  very  dissatisfied,  dissatisfied,  neither  satisfied  nor 

dissatisfied. 

satisfied,  or  very  satisfied,  how  satisfied 

are  you  with  the  overall 

relevance  of  your 

program? 

Very                            Neither  satisfied 

Very 

No  Answer 

dissatisfied  Dissatisfied     nor  dissatisfied 

Satisfied  Satisfied 

[DO  NOT  READ] 

1                  2  3 

4  5 

0 
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3.8  Overall,  how  satisfied  are  you  with  the  courses  you  were  taught  in  your  own  faculty'^. 

[READ  SCALE  AGAIN,  IF  NECESSARY.] 

[INSTRUCTIONS  TO  INTERVIEWERS:  FOR  U  OF  L  STUDENTS  IN  THE  COMBINED  DEGREES 
PROGRAM  IN  TEACHER  PREPARATION,  REWORD  THE  QUESTION:  "OVERALL,  HOW 
SATISFIED  ARE  YOU  WITH  THE  COURSES  YOU  WERE  TAUGHT  IN  THE  FACULTY  OF 
EDUCATION!  WOULD  YOU  SAY  YOU  ARE  VERY  DISSATISFIED,  DISSATISFIED,  NEITHER 
SATISFIED  NOR  DISSATISFIED,  SATISFIED,  OR  VERY  SATISFIED?] 

[FOR  STUDENTS  FROM  OTHER  UNIVERSITIES  IN  DUAL  FACULTIES,  ASK  THEM  TO 
RESPOND  IN  GENERAL  TO  BOTH  FACULTIES.] 

Very  Neither  satisfied  Very  No  Answer 

dissatisfied  Dissatisfied     nor  dissatisfied       Satisfied  Satisfied        [DO  NOT  READ] 

1  2  3  4  5  0 

3.9  Overall,  how  satisfied  are  you  with  the  courses  you  were  taught  in  other  faculties?  [READ 
SCALE  AGAIN,  IF  NECESSARY.] 

Very  Neither  satisfied  Very  No  Answer 

dissatisfied  Dissatisfied     nor  dissatisfied       Satisfied  Satisfied        [DO  NOT  READ] 

1  2  3  4  5  0 


3.10  Overall,  how  satisfied  are  you  with  the  quality  of  your  educational  experience? 
[READ  SCALE  AGAIN,  IF  NECESSARY.] 

Very  Neither  satisfied  Very  No  Answer 

dissatisfied  Dissatisfied     nor  dissatisfied       Satisfied  Satisfied        [DO  NOT  READ] 

1  2  3  4  5  0 

3.11  If  you  could  choose  again,  would  you  choose  the  same  program  of  studies? 

1  Yes 

3  Maybe 

2  No 


3.12     If  you  could  choose  again,  would  you  choose  to  attend  the  same  university? 

1  Yes 

3  Maybe 

2  No 


This  concludes  the  Alberta  Universities'  Survey.  Thank  you  for  taking  the  time  to  reflect  on  your 
university  experience  and  to  share  your  thoughts. 
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Appendix  C 


Private  Colleges'  Common  Questions  -  Graduating  Student 
Satisfaction  Survey  -  May  1996 


The  common  questions  agreed  to  by  the  four  private  colleges  and  included  in  the  Graduating  Student 
surveys  last  administered  are  as  follows: 

1 .6  What  degree  do  you  expect  to  receive  at  convocation? 

B.A. 
B.Sc. 

B.Ed,  (as  applicable) 

1.7  Will  your  degree  be  a  General  (3-year)  or  a  Special  (4-year)  degree? 

General  (3-year) 
Special  (4-year) 

Certificate  of  Equivalence  (the  equivalent  of  a  Special  Degree  for  holders  of  a  previous  General 
degree) 


3.9  Please  rate  the  following  aspects  of  your  experience  at  (institution): 


a.  the  effectiveness  of  the  instructors  from  whom  you 
have  taken  courses  at  (institution) 

b.  the  quality  of  courses  you  took  at  (institution) 

c.  the  relevance  of  your  educational  experience  at 
(institution)  to  your  educational  goals 

d.  the  quality  of  your  overall  educational  experience  at 
(institution) 


Poor 


Excellent 


3.9      To  what  degree  did  the  program  you  completed  provide  you  with  the  following  benefits: 


Definitely 
did  not 
provide 

Did  not 
provide 

Uncertain 

Provided 

Definitely 
provided 

a. 

breadth  of  knowledge 

1 

2 

3 

4 

5 

b. 

in-depth  knowledge  of  a  field  of 
study 

1 

2 

3 

4 

5 

c. 

an  opportunity  to  improve  yourself 
generally 

1 

2 

3 

4 

5 

d. 

preparation  for  further  education 

1 

2 

3 

4 

5 
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3.10     How  strongly  do  you  agree  or  disagree  with  the  following  statements: 


Strongly 

Strongly 

disagree 

agree 

a.  I  made  the  right  decision  in 

choosing  (institution)  1  2  3  4  5 

b.  I  made  the  right  decision  in 

choosing  my  program  of  studies  1  2  3  4  5 

c.  I  would  recommend  (institution)  to 
a  friend  or  relative  planning  to 

attend  university  1  2  3  4  5 
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